Max level shown:
12024-11-06T00:30:00.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 02eabb51-c346-4963-9b95-58e236ea786f roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22024-11-06T00:30:00.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 02eabb51-c346-4963-9b95-58e236ea786f resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
32024-11-06T00:30:00.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 02eabb51-c346-4963-9b95-58e236ea786f response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
42024-11-06T00:30:01.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 664 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = 3c47a2b4-b48f-4d88-b033-17ef80de8ade response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
52024-11-06T00:30:01.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7311efbd-e1b3-4c77-a388-2d18008b35d9 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
62024-11-06T00:30:01.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7311efbd-e1b3-4c77-a388-2d18008b35d9 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
72024-11-06T00:30:01.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7311efbd-e1b3-4c77-a388-2d18008b35d9 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
82024-11-06T00:30:02.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cf6e7260-5978-466b-a7fb-6915ad0f57c6 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
92024-11-06T00:30:02.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cf6e7260-5978-466b-a7fb-6915ad0f57c6 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
102024-11-06T00:30:02.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cf6e7260-5978-466b-a7fb-6915ad0f57c6 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
112024-11-06T00:30:03.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e03f5fae-06d3-48e6-9dc1-3e80eda04459 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
122024-11-06T00:30:03.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e03f5fae-06d3-48e6-9dc1-3e80eda04459 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
132024-11-06T00:30:03.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e03f5fae-06d3-48e6-9dc1-3e80eda04459 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
142024-11-06T00:30:04.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a6574f5f-7388-47ca-86ee-4d3d69335a41 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
152024-11-06T00:30:04.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a6574f5f-7388-47ca-86ee-4d3d69335a41 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
162024-11-06T00:30:04.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a6574f5f-7388-47ca-86ee-4d3d69335a41 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
172024-11-06T00:30:05.495ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
182024-11-06T00:30:05.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
192024-11-06T00:30:05.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
202024-11-06T00:30:05.496ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
212024-11-06T00:30:05.496ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
222024-11-06T00:30:05.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
232024-11-06T00:30:05.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
242024-11-06T00:30:05.498ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
252024-11-06T00:30:05.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
262024-11-06T00:30:05.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
272024-11-06T00:30:05.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
282024-11-06T00:30:05.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
292024-11-06T00:30:05.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.976448ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
302024-11-06T00:30:05.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
312024-11-06T00:30:05.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
322024-11-06T00:30:05.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
332024-11-06T00:30:05.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
342024-11-06T00:30:05.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
352024-11-06T00:30:05.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
362024-11-06T00:30:05.515ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
372024-11-06T00:30:05.515ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.284272ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
382024-11-06T00:30:06.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fda52ed6-3927-47a1-a45d-464342a410f2 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
392024-11-06T00:30:06.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fda52ed6-3927-47a1-a45d-464342a410f2 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
402024-11-06T00:30:06.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fda52ed6-3927-47a1-a45d-464342a410f2 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
412024-11-06T00:30:06.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 7af4eb7b-47d3-4db1-9e2c-30266e9c8221 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
422024-11-06T00:30:06.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 7af4eb7b-47d3-4db1-9e2c-30266e9c8221 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
432024-11-06T00:30:06.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 7af4eb7b-47d3-4db1-9e2c-30266e9c8221 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
442024-11-06T00:30:06.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 1d5b3145-eaf3-469b-98be-62a632785cf5 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
452024-11-06T00:30:06.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 1d5b3145-eaf3-469b-98be-62a632785cf5 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
462024-11-06T00:30:06.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 1d5b3145-eaf3-469b-98be-62a632785cf5 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
472024-11-06T00:30:07.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c8429c9a-a551-40da-9aac-fc4f4aa6519b roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
482024-11-06T00:30:07.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c8429c9a-a551-40da-9aac-fc4f4aa6519b resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
492024-11-06T00:30:07.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c8429c9a-a551-40da-9aac-fc4f4aa6519b response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
502024-11-06T00:30:08.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 07b53b5a-0ef3-457f-a49d-c5b77bc20833 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
512024-11-06T00:30:08.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 07b53b5a-0ef3-457f-a49d-c5b77bc20833 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
522024-11-06T00:30:08.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 07b53b5a-0ef3-457f-a49d-c5b77bc20833 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
532024-11-06T00:30:09.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 46bf1c58-bf41-4f7f-9e7a-e22fe9da2743 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
542024-11-06T00:30:09.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 46bf1c58-bf41-4f7f-9e7a-e22fe9da2743 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
552024-11-06T00:30:09.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 46bf1c58-bf41-4f7f-9e7a-e22fe9da2743 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
562024-11-06T00:30:10.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e24b1716-cc94-42c9-8214-d53e6bfeacab roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
572024-11-06T00:30:10.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e24b1716-cc94-42c9-8214-d53e6bfeacab resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
582024-11-06T00:30:10.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e24b1716-cc94-42c9-8214-d53e6bfeacab response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
592024-11-06T00:30:11.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c65cdfa4-d809-45f7-8d7f-8e003efd6089 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
602024-11-06T00:30:11.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c65cdfa4-d809-45f7-8d7f-8e003efd6089 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
612024-11-06T00:30:11.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c65cdfa4-d809-45f7-8d7f-8e003efd6089 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
622024-11-06T00:30:12.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f94e6721-f786-4fcd-8b9b-90a9510ed758 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
632024-11-06T00:30:12.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f94e6721-f786-4fcd-8b9b-90a9510ed758 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
642024-11-06T00:30:12.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f94e6721-f786-4fcd-8b9b-90a9510ed758 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
652024-11-06T00:30:13.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c85f3b3c-5ad1-40d7-a8ab-82411947fd91 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
662024-11-06T00:30:13.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c85f3b3c-5ad1-40d7-a8ab-82411947fd91 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
672024-11-06T00:30:13.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c85f3b3c-5ad1-40d7-a8ab-82411947fd91 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
682024-11-06T00:30:14.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 39f55a14-8b15-4222-b14c-3a3b0a398224 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
692024-11-06T00:30:14.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 39f55a14-8b15-4222-b14c-3a3b0a398224 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
702024-11-06T00:30:14.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 39f55a14-8b15-4222-b14c-3a3b0a398224 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
712024-11-06T00:30:15.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 1e858c5e-b630-461b-ba22-43d1ba43e353 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
722024-11-06T00:30:15.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 1e858c5e-b630-461b-ba22-43d1ba43e353 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
732024-11-06T00:30:15.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 1e858c5e-b630-461b-ba22-43d1ba43e353 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
742024-11-06T00:30:15.495ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
752024-11-06T00:30:15.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
762024-11-06T00:30:15.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
772024-11-06T00:30:15.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
782024-11-06T00:30:15.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
792024-11-06T00:30:15.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
802024-11-06T00:30:15.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
812024-11-06T00:30:15.498ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
822024-11-06T00:30:15.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
832024-11-06T00:30:15.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.305337ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
842024-11-06T00:30:15.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
852024-11-06T00:30:15.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
862024-11-06T00:30:15.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
872024-11-06T00:30:15.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
882024-11-06T00:30:15.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
892024-11-06T00:30:15.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
902024-11-06T00:30:15.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
912024-11-06T00:30:15.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
922024-11-06T00:30:15.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
932024-11-06T00:30:15.515ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
942024-11-06T00:30:15.515ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.044405ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
952024-11-06T00:30:16.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6acb2e42-3d88-474a-a532-6ddcd2f210c9 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
962024-11-06T00:30:16.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6acb2e42-3d88-474a-a532-6ddcd2f210c9 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
972024-11-06T00:30:16.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6acb2e42-3d88-474a-a532-6ddcd2f210c9 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
982024-11-06T00:30:16.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 538 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = 5dffc60b-443c-4530-93a4-5f4ae75e7d1f response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
992024-11-06T00:30:17.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5e1dc0c9-9bae-4106-8f03-2e6bcba8352c roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1002024-11-06T00:30:17.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5e1dc0c9-9bae-4106-8f03-2e6bcba8352c resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1012024-11-06T00:30:17.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5e1dc0c9-9bae-4106-8f03-2e6bcba8352c response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1022024-11-06T00:30:18.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0ff5a9ea-208f-4af9-9996-f05b2365c3b6 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1032024-11-06T00:30:18.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0ff5a9ea-208f-4af9-9996-f05b2365c3b6 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1042024-11-06T00:30:18.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0ff5a9ea-208f-4af9-9996-f05b2365c3b6 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1052024-11-06T00:30:19.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f7472a22-0d63-4b89-ac39-0c2fbd2ac448 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1062024-11-06T00:30:19.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f7472a22-0d63-4b89-ac39-0c2fbd2ac448 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1072024-11-06T00:30:19.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f7472a22-0d63-4b89-ac39-0c2fbd2ac448 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1082024-11-06T00:30:20.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cc6b1bbc-216f-4931-b241-411071da3d73 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1092024-11-06T00:30:20.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cc6b1bbc-216f-4931-b241-411071da3d73 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1102024-11-06T00:30:20.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cc6b1bbc-216f-4931-b241-411071da3d73 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1112024-11-06T00:30:21.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 93cb05a4-562a-4615-853f-7cd7ff96ed7d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1122024-11-06T00:30:21.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 93cb05a4-562a-4615-853f-7cd7ff96ed7d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1132024-11-06T00:30:21.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 93cb05a4-562a-4615-853f-7cd7ff96ed7d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1142024-11-06T00:30:22.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 690c5117-22be-4602-86fe-9b9f78fe259d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1152024-11-06T00:30:22.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 690c5117-22be-4602-86fe-9b9f78fe259d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1162024-11-06T00:30:22.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 690c5117-22be-4602-86fe-9b9f78fe259d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1172024-11-06T00:30:23.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 52b5319a-cde0-4f33-950c-7e391e435d8c roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1182024-11-06T00:30:23.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 52b5319a-cde0-4f33-950c-7e391e435d8c resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1192024-11-06T00:30:23.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 52b5319a-cde0-4f33-950c-7e391e435d8c response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1202024-11-06T00:30:24.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 826227f4-2ad5-4b13-8a50-9018c09039c7 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1212024-11-06T00:30:24.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 826227f4-2ad5-4b13-8a50-9018c09039c7 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1222024-11-06T00:30:24.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 826227f4-2ad5-4b13-8a50-9018c09039c7 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1232024-11-06T00:30:25.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = b4b22179-9762-4bc4-8487-94345f9e697c roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1242024-11-06T00:30:25.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = b4b22179-9762-4bc4-8487-94345f9e697c resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1252024-11-06T00:30:25.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = b4b22179-9762-4bc4-8487-94345f9e697c response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
1262024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
1272024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
1282024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1292024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
1302024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1312024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1322024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1332024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
1342024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1352024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
1362024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1372024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
1382024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
1392024-11-06T00:30:25.495ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:20:25.495450903 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1402024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1412024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1422024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
1432024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
1442024-11-06T00:30:25.495ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1452024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
1462024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1472024-11-06T00:30:25.495ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
1482024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
1492024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
1502024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.861\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
1512024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
1522024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
1532024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1542024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
1552024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1562024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1572024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
1582024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1592024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
1602024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
1612024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1622024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
1632024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1642024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
1652024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
1662024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.64\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
1672024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
1682024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1692024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1702024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1712024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
1722024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1732024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
1742024-11-06T00:30:25.495ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1752024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1762024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
1772024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1782024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
1792024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.43\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
1802024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
1812024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
1822024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.18\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1832024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
1842024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1852024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.731\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1862024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1872024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1882024-11-06T00:30:25.495ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
1892024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1902024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1912024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1922024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1932024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1942024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1952024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1962024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1972024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1982024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1992024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2002024-11-06T00:30:25.496ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1688, tv_nsec: 842403226 } })
2012024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2022024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2032024-11-06T00:30:25.496ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1688, tv_nsec: 842508479 } })
2042024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2052024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2062024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2072024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2082024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2092024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2102024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
2112024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.125914ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
2122024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
2132024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.229967ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
2142024-11-06T00:30:25.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2152024-11-06T00:30:25.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2162024-11-06T00:30:25.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2172024-11-06T00:30:25.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2182024-11-06T00:30:25.499ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.086052ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2192024-11-06T00:30:25.499ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2202024-11-06T00:30:25.500ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:20:25.495450903 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2212024-11-06T00:30:25.500ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.879705ms iteration = 12 status = {"expiration":"2024-11-06T00:20:25.495450903Z","pruned":[]}
2222024-11-06T00:30:25.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2232024-11-06T00:30:25.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2242024-11-06T00:30:25.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2252024-11-06T00:30:25.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2262024-11-06T00:30:25.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2272024-11-06T00:30:25.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2282024-11-06T00:30:25.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2292024-11-06T00:30:25.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2302024-11-06T00:30:25.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2312024-11-06T00:30:25.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2322024-11-06T00:30:25.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2332024-11-06T00:30:25.505ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2342024-11-06T00:30:25.506ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1688, tv_nsec: 852570427 } })
2352024-11-06T00:30:25.506ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1688, tv_nsec: 852603879 } })
2362024-11-06T00:30:25.506ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
2372024-11-06T00:30:25.507ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2382024-11-06T00:30:25.507ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
2392024-11-06T00:30:25.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2402024-11-06T00:30:25.507ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2412024-11-06T00:30:25.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2422024-11-06T00:30:25.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2432024-11-06T00:30:25.509ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2442024-11-06T00:30:25.509ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2452024-11-06T00:30:25.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2462024-11-06T00:30:25.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2472024-11-06T00:30:25.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2482024-11-06T00:30:25.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2492024-11-06T00:30:25.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2502024-11-06T00:30:25.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2512024-11-06T00:30:25.511ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.770948ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
2522024-11-06T00:30:25.512ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2532024-11-06T00:30:25.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2542024-11-06T00:30:25.515ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2552024-11-06T00:30:25.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2562024-11-06T00:30:25.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2572024-11-06T00:30:25.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2582024-11-06T00:30:25.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2592024-11-06T00:30:25.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2602024-11-06T00:30:25.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2612024-11-06T00:30:25.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2622024-11-06T00:30:25.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2632024-11-06T00:30:25.518ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2642024-11-06T00:30:25.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2652024-11-06T00:30:25.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2662024-11-06T00:30:25.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2672024-11-06T00:30:25.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2682024-11-06T00:30:25.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2692024-11-06T00:30:25.523ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2702024-11-06T00:30:25.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2712024-11-06T00:30:25.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2722024-11-06T00:30:25.525ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1688, tv_nsec: 872110628 } })
2732024-11-06T00:30:25.526ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
2742024-11-06T00:30:25.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2752024-11-06T00:30:25.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2762024-11-06T00:30:25.528ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2772024-11-06T00:30:25.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2782024-11-06T00:30:25.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2792024-11-06T00:30:25.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2802024-11-06T00:30:25.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2812024-11-06T00:30:25.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2822024-11-06T00:30:25.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2832024-11-06T00:30:25.533ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2842024-11-06T00:30:25.533ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 37.826573ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2852024-11-06T00:30:25.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2862024-11-06T00:30:25.533ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2872024-11-06T00:30:25.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2882024-11-06T00:30:25.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2892024-11-06T00:30:25.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2902024-11-06T00:30:25.539ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2912024-11-06T00:30:25.541ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2922024-11-06T00:30:25.541ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2932024-11-06T00:30:25.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2942024-11-06T00:30:25.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2952024-11-06T00:30:25.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2962024-11-06T00:30:25.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2972024-11-06T00:30:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2982024-11-06T00:30:25.545ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2992024-11-06T00:30:25.545ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3002024-11-06T00:30:25.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3012024-11-06T00:30:25.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3022024-11-06T00:30:25.547ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3032024-11-06T00:30:25.547ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3042024-11-06T00:30:25.547ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 51.580201ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3052024-11-06T00:30:25.547ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
3062024-11-06T00:30:25.547ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
3072024-11-06T00:30:25.547ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 51.642474ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
3082024-11-06T00:30:25.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3092024-11-06T00:30:25.552ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3102024-11-06T00:30:25.552ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3112024-11-06T00:30:25.552ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3122024-11-06T00:30:25.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3132024-11-06T00:30:25.552ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3142024-11-06T00:30:25.552ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3152024-11-06T00:30:25.552ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 56.901789ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3162024-11-06T00:30:25.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3172024-11-06T00:30:25.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3182024-11-06T00:30:25.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3192024-11-06T00:30:25.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3202024-11-06T00:30:25.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3212024-11-06T00:30:25.557ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3222024-11-06T00:30:25.557ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3232024-11-06T00:30:25.557ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3242024-11-06T00:30:25.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3252024-11-06T00:30:25.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3262024-11-06T00:30:25.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3272024-11-06T00:30:25.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3282024-11-06T00:30:25.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3292024-11-06T00:30:25.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3302024-11-06T00:30:25.560ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3312024-11-06T00:30:25.560ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
3322024-11-06T00:30:25.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3332024-11-06T00:30:25.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3342024-11-06T00:30:25.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3352024-11-06T00:30:25.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3362024-11-06T00:30:25.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3372024-11-06T00:30:25.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3382024-11-06T00:30:25.563ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3392024-11-06T00:30:25.563ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3402024-11-06T00:30:25.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3412024-11-06T00:30:25.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3422024-11-06T00:30:25.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3432024-11-06T00:30:25.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3442024-11-06T00:30:25.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3452024-11-06T00:30:25.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3462024-11-06T00:30:25.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3472024-11-06T00:30:25.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3482024-11-06T00:30:25.567ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
3492024-11-06T00:30:25.567ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3502024-11-06T00:30:25.567ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
3512024-11-06T00:30:25.567ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 71.991098ms iteration = 12 status = {"generation":2}
3522024-11-06T00:30:25.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.761151ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3532024-11-06T00:30:25.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.168273ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3542024-11-06T00:30:25.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3552024-11-06T00:30:25.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3562024-11-06T00:30:25.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3572024-11-06T00:30:25.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3582024-11-06T00:30:25.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
3592024-11-06T00:30:25.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3602024-11-06T00:30:25.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3612024-11-06T00:30:25.575ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3622024-11-06T00:30:25.575ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3632024-11-06T00:30:25.575ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
3642024-11-06T00:30:25.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 80.423028ms iteration = 12 status = {"generation":1}
3652024-11-06T00:30:25.580ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) }
3662024-11-06T00:30:25.580ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 84.792327ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3672024-11-06T00:30:25.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
3682024-11-06T00:30:25.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.34595ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
3692024-11-06T00:30:25.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3702024-11-06T00:30:25.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3712024-11-06T00:30:25.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3722024-11-06T00:30:25.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
3732024-11-06T00:30:25.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3742024-11-06T00:30:25.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3752024-11-06T00:30:25.600ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.241904ms iteration = 23 status = 0
3762024-11-06T00:30:25.612ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3772024-11-06T00:30:25.617ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3782024-11-06T00:30:25.638ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3792024-11-06T00:30:25.638ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
3802024-11-06T00:30:25.638ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3812024-11-06T00:30:25.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3822024-11-06T00:30:25.639ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f37c53d7-0b8c-41c5-b7c1-4c8d93d1c7cb", "content-length": "26", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
3832024-11-06T00:30:25.639ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3842024-11-06T00:30:25.641ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3852024-11-06T00:30:25.651ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
3862024-11-06T00:30:25.651ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3872024-11-06T00:30:25.651ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0996bf3b-a6ac-4faa-b03c-e2e95c7bc39a", "content-length": "26", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
3882024-11-06T00:30:25.651ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3892024-11-06T00:30:25.652ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3902024-11-06T00:30:25.657ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.425362ms iteration = 26 status = {"physical_disks_added":0}
3912024-11-06T00:30:25.666ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
3922024-11-06T00:30:25.666ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3932024-11-06T00:30:25.667ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4ca923d-b103-4f01-bd6e-17fd07bd47cb", "content-length": "26", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
3942024-11-06T00:30:25.667ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3952024-11-06T00:30:25.668ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
3962024-11-06T00:30:25.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3972024-11-06T00:30:25.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3982024-11-06T00:30:25.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3992024-11-06T00:30:25.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4002024-11-06T00:30:25.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4012024-11-06T00:30:25.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4022024-11-06T00:30:25.694ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4032024-11-06T00:30:25.694ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 198.668418ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4042024-11-06T00:30:25.782ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4052024-11-06T00:30:25.783ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "486e8244-7e90-4e48-b5d6-f3f7fd48fe67", "content-length": "1", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
4062024-11-06T00:30:25.784ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4072024-11-06T00:30:25.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4082024-11-06T00:30:25.797ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4092024-11-06T00:30:25.829ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 334.13907ms iteration = 23 status = {}
4102024-11-06T00:30:25.901ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4112024-11-06T00:30:25.901ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4122024-11-06T00:30:25.901ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4132024-11-06T00:30:25.901ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a5d90ae6-0eaf-4988-9cc0-1372b78d1050", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4142024-11-06T00:30:25.901ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4152024-11-06T00:30:25.903ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8821a2b8-6972-408f-bbfb-46dcb4b43301", "content-length": "372", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
4162024-11-06T00:30:25.903ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "79713aca-1100-4ef8-8d9c-fe687ab36a05", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4172024-11-06T00:30:25.903ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4182024-11-06T00:30:25.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4192024-11-06T00:30:25.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4202024-11-06T00:30:25.905ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4212024-11-06T00:30:25.905ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 409.673422ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4222024-11-06T00:30:25.908ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 412.426594ms iteration = 23 status = null
4232024-11-06T00:30:25.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4242024-11-06T00:30:25.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4252024-11-06T00:30:25.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4262024-11-06T00:30:25.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4272024-11-06T00:30:25.914ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4282024-11-06T00:30:25.915ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2c3daece-56f1-43e4-bc71-f6152852aa39", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4292024-11-06T00:30:25.915ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4302024-11-06T00:30:25.917ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a14e39ef-53cf-452e-94ed-20167901ca2f", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4312024-11-06T00:30:25.917ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4322024-11-06T00:30:25.923ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e35b3115-916b-4bd3-a30e-370cf403881a", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4332024-11-06T00:30:25.923ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4342024-11-06T00:30:25.925ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4352024-11-06T00:30:25.925ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 430.429848ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4362024-11-06T00:30:25.930ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
4372024-11-06T00:30:25.930ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4382024-11-06T00:30:25.930ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "77ad00d0-b920-4530-92b0-72a86742c83e", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
4392024-11-06T00:30:25.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4402024-11-06T00:30:25.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4412024-11-06T00:30:25.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4422024-11-06T00:30:25.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4432024-11-06T00:30:25.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4442024-11-06T00:30:25.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4452024-11-06T00:30:25.940ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4462024-11-06T00:30:25.940ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4472024-11-06T00:30:25.941ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "20f6e358-ac81-4540-850d-5278a2e15449", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
4482024-11-06T00:30:25.942ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 446.822975ms iteration = 23 status = {}
4492024-11-06T00:30:25.972ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4502024-11-06T00:30:25.972ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf91979f-d3a4-4f0b-9151-36bb201ee890", "content-length": "691", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
4512024-11-06T00:30:25.972ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
4522024-11-06T00:30:25.972ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4532024-11-06T00:30:25.972ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
4542024-11-06T00:30:25.973ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 478.177876ms iteration = 23 status = {}
4552024-11-06T00:30:25.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4562024-11-06T00:30:25.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4572024-11-06T00:30:25.978ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
4582024-11-06T00:30:25.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4592024-11-06T00:30:25.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4602024-11-06T00:30:25.987ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4612024-11-06T00:30:25.988ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc78b4ea-cbd9-4c47-a6e6-af34276abcd7", "content-length": "121", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
4622024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
4632024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
4642024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4652024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4662024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4672024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4682024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4692024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4702024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4712024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4722024-11-06T00:30:25.988ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
4732024-11-06T00:30:25.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4742024-11-06T00:30:25.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4752024-11-06T00:30:25.990ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4762024-11-06T00:30:25.991ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d93a8bd-aec6-4acd-89b2-60c618f515c6", "content-length": "2", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
4772024-11-06T00:30:25.991ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4782024-11-06T00:30:25.991ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "025e537c-87c5-466f-8483-e12321875d84", "content-length": "52", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
4792024-11-06T00:30:25.991ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
4802024-11-06T00:30:25.991ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4812024-11-06T00:30:26.102ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e6c4df9b-9bd5-4b6a-98e1-7e385fb7cf6b", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
4822024-11-06T00:30:26.102ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
4832024-11-06T00:30:26.102ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4842024-11-06T00:30:26.102ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f06049c-455f-45ab-a3e6-4750293cd8d0", "content-length": "669", "date": "Wed, 06 Nov 2024 00:30:25 GMT"} })
4852024-11-06T00:30:26.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4862024-11-06T00:30:26.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4872024-11-06T00:30:26.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4882024-11-06T00:30:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4892024-11-06T00:30:26.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4902024-11-06T00:30:26.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4912024-11-06T00:30:26.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4922024-11-06T00:30:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4932024-11-06T00:30:26.118ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 622.623785ms iteration = 23 status = {}
4942024-11-06T00:30:26.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 06677a55-f875-4fa4-90d9-d54cc5a8c76d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
4952024-11-06T00:30:26.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 06677a55-f875-4fa4-90d9-d54cc5a8c76d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
4962024-11-06T00:30:26.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 06677a55-f875-4fa4-90d9-d54cc5a8c76d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
4972024-11-06T00:30:26.309ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
4982024-11-06T00:30:26.309ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
4992024-11-06T00:30:26.339ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
5002024-11-06T00:30:26.339ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:50077
5012024-11-06T00:30:26.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50077 req_id = 9afe9c2b-491c-4204-8515-c067637c75c5 roles = RoleSet { roles: {} } uri = /metrics/producers
5022024-11-06T00:30:26.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50077 req_id = 9afe9c2b-491c-4204-8515-c067637c75c5 resource = Database result = Ok(()) uri = /metrics/producers
5032024-11-06T00:30:26.378ZINFOnexus: assigned collector to new producer collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e file = nexus/src/app/oximeter.rs:76 producer_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
5042024-11-06T00:30:26.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38676 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50077 req_id = 9afe9c2b-491c-4204-8515-c067637c75c5 response_code = 201 uri = /metrics/producers
5052024-11-06T00:30:26.378ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9afe9c2b-491c-4204-8515-c067637c75c5", "content-length": "41", "date": "Wed, 06 Nov 2024 00:30:26 GMT"} })
5062024-11-06T00:30:26.380ZDEBGnexus (producer-registration-task): registered with nexus successfully
5072024-11-06T00:30:26.380ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
5082024-11-06T00:30:26.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 14150c96-7906-4d2c-9916-0656bfc81e96 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5092024-11-06T00:30:26.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 14150c96-7906-4d2c-9916-0656bfc81e96 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5102024-11-06T00:30:26.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 14150c96-7906-4d2c-9916-0656bfc81e96 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5112024-11-06T00:30:27.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3ebcc1b1-c7ff-407a-985e-0787b2b6cee7 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5122024-11-06T00:30:27.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3ebcc1b1-c7ff-407a-985e-0787b2b6cee7 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5132024-11-06T00:30:27.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3ebcc1b1-c7ff-407a-985e-0787b2b6cee7 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5142024-11-06T00:30:28.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = dddf394e-eeda-4fff-a20f-a968d431888a roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5152024-11-06T00:30:28.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = dddf394e-eeda-4fff-a20f-a968d431888a resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5162024-11-06T00:30:28.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = dddf394e-eeda-4fff-a20f-a968d431888a response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5172024-11-06T00:30:29.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ec208e6c-2e0b-440d-9a04-308625b287dd roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5182024-11-06T00:30:29.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ec208e6c-2e0b-440d-9a04-308625b287dd resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5192024-11-06T00:30:29.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ec208e6c-2e0b-440d-9a04-308625b287dd response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5202024-11-06T00:30:30.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 63248eac-1fd2-44fc-9738-9ee695654388 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5212024-11-06T00:30:30.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 63248eac-1fd2-44fc-9738-9ee695654388 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5222024-11-06T00:30:30.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 63248eac-1fd2-44fc-9738-9ee695654388 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5232024-11-06T00:30:31.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 919 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = 4aa75197-b97f-4143-80a9-a91b7c96f5a2 response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
5242024-11-06T00:30:31.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 55fc8c76-08f3-448d-aed0-50aa7726ed6f roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5252024-11-06T00:30:31.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 55fc8c76-08f3-448d-aed0-50aa7726ed6f resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5262024-11-06T00:30:31.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 55fc8c76-08f3-448d-aed0-50aa7726ed6f response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5272024-11-06T00:30:32.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 2923c22a-1958-497b-a469-2d9791ea5475 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5282024-11-06T00:30:32.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 2923c22a-1958-497b-a469-2d9791ea5475 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5292024-11-06T00:30:32.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 2923c22a-1958-497b-a469-2d9791ea5475 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5302024-11-06T00:30:33.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3f9e64e2-85c7-447a-ab47-a4fcb0eeb082 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5312024-11-06T00:30:33.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3f9e64e2-85c7-447a-ab47-a4fcb0eeb082 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5322024-11-06T00:30:33.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3f9e64e2-85c7-447a-ab47-a4fcb0eeb082 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5332024-11-06T00:30:34.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = dbb50b95-2a12-488b-a3d4-9e1cd6f19404 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5342024-11-06T00:30:34.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = dbb50b95-2a12-488b-a3d4-9e1cd6f19404 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5352024-11-06T00:30:34.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = dbb50b95-2a12-488b-a3d4-9e1cd6f19404 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5362024-11-06T00:30:35.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
5372024-11-06T00:30:35.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5382024-11-06T00:30:35.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5392024-11-06T00:30:35.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
5402024-11-06T00:30:35.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5412024-11-06T00:30:35.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5422024-11-06T00:30:35.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432024-11-06T00:30:35.497ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5442024-11-06T00:30:35.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5452024-11-06T00:30:35.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5462024-11-06T00:30:35.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5472024-11-06T00:30:35.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.661899ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5482024-11-06T00:30:35.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5492024-11-06T00:30:35.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5502024-11-06T00:30:35.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5512024-11-06T00:30:35.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5522024-11-06T00:30:35.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
5532024-11-06T00:30:35.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5542024-11-06T00:30:35.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5552024-11-06T00:30:35.517ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
5562024-11-06T00:30:35.517ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.860839ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
5572024-11-06T00:30:35.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 24088c72-4e67-4398-b7e2-9447cd236410 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5582024-11-06T00:30:35.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 24088c72-4e67-4398-b7e2-9447cd236410 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5592024-11-06T00:30:35.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 24088c72-4e67-4398-b7e2-9447cd236410 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5602024-11-06T00:30:36.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = c350433a-eb4c-42cc-801f-71a5cd66540e roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
5612024-11-06T00:30:36.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = c350433a-eb4c-42cc-801f-71a5cd66540e resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
5622024-11-06T00:30:36.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = c350433a-eb4c-42cc-801f-71a5cd66540e response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
5632024-11-06T00:30:36.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 4d0458d5-9687-475b-afd3-acb9220c4127 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
5642024-11-06T00:30:36.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 4d0458d5-9687-475b-afd3-acb9220c4127 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
5652024-11-06T00:30:36.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 4d0458d5-9687-475b-afd3-acb9220c4127 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
5662024-11-06T00:30:36.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d84c69ba-6bcd-4eda-8661-d44f8a678517 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5672024-11-06T00:30:36.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d84c69ba-6bcd-4eda-8661-d44f8a678517 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5682024-11-06T00:30:36.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d84c69ba-6bcd-4eda-8661-d44f8a678517 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5692024-11-06T00:30:37.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 93829786-15d5-483b-ad65-d911f0bc21b4 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5702024-11-06T00:30:37.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 93829786-15d5-483b-ad65-d911f0bc21b4 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5712024-11-06T00:30:37.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 93829786-15d5-483b-ad65-d911f0bc21b4 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5722024-11-06T00:30:38.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64e2177f-dd98-4c65-b17d-8711621da0a9 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5732024-11-06T00:30:38.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64e2177f-dd98-4c65-b17d-8711621da0a9 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5742024-11-06T00:30:38.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64e2177f-dd98-4c65-b17d-8711621da0a9 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5752024-11-06T00:30:39.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c111cd29-82c5-45c3-94b6-aeb5cf477466 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5762024-11-06T00:30:39.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c111cd29-82c5-45c3-94b6-aeb5cf477466 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5772024-11-06T00:30:39.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c111cd29-82c5-45c3-94b6-aeb5cf477466 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5782024-11-06T00:30:40.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e18b7e88-c427-434c-a7b0-dacd916aece3 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5792024-11-06T00:30:40.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e18b7e88-c427-434c-a7b0-dacd916aece3 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5802024-11-06T00:30:40.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e18b7e88-c427-434c-a7b0-dacd916aece3 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5812024-11-06T00:30:41.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5520fc26-1f62-4ecf-a7eb-bf4ea1d5a083 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5822024-11-06T00:30:41.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5520fc26-1f62-4ecf-a7eb-bf4ea1d5a083 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5832024-11-06T00:30:41.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5520fc26-1f62-4ecf-a7eb-bf4ea1d5a083 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5842024-11-06T00:30:42.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 66a1b6cc-0d03-45ce-82d7-f5e937d2846c roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5852024-11-06T00:30:42.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 66a1b6cc-0d03-45ce-82d7-f5e937d2846c resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5862024-11-06T00:30:42.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 66a1b6cc-0d03-45ce-82d7-f5e937d2846c response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5872024-11-06T00:30:43.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7d2f7104-bb10-4756-8d93-ef1042479b20 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5882024-11-06T00:30:43.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7d2f7104-bb10-4756-8d93-ef1042479b20 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5892024-11-06T00:30:43.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7d2f7104-bb10-4756-8d93-ef1042479b20 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5902024-11-06T00:30:44.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 311b5a0a-f113-4ace-9282-347302bf5bb5 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5912024-11-06T00:30:44.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 311b5a0a-f113-4ace-9282-347302bf5bb5 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5922024-11-06T00:30:44.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 311b5a0a-f113-4ace-9282-347302bf5bb5 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
5932024-11-06T00:30:45.495ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
5942024-11-06T00:30:45.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5952024-11-06T00:30:45.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5962024-11-06T00:30:45.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
5972024-11-06T00:30:45.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5982024-11-06T00:30:45.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5992024-11-06T00:30:45.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6002024-11-06T00:30:45.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6012024-11-06T00:30:45.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6022024-11-06T00:30:45.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6032024-11-06T00:30:45.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6042024-11-06T00:30:45.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6052024-11-06T00:30:45.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062024-11-06T00:30:45.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
6072024-11-06T00:30:45.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6082024-11-06T00:30:45.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6092024-11-06T00:30:45.520ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
6102024-11-06T00:30:45.520ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.680393ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
6112024-11-06T00:30:45.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6122024-11-06T00:30:45.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6132024-11-06T00:30:45.556ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.387663ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6142024-11-06T00:30:45.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4917df11-e3b0-4e49-81cb-52de4101a0b0 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6152024-11-06T00:30:45.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4917df11-e3b0-4e49-81cb-52de4101a0b0 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6162024-11-06T00:30:45.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4917df11-e3b0-4e49-81cb-52de4101a0b0 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6172024-11-06T00:30:46.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 542 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = 6ef8a579-9300-42d1-99f5-06d3d402e3cc response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
6182024-11-06T00:30:46.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = bfff29ae-6829-4472-b7a1-d77cfcb3383d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6192024-11-06T00:30:46.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = bfff29ae-6829-4472-b7a1-d77cfcb3383d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6202024-11-06T00:30:46.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = bfff29ae-6829-4472-b7a1-d77cfcb3383d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6212024-11-06T00:30:47.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9678d312-8c1d-411d-9e1a-2a79e1b30f46 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6222024-11-06T00:30:47.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9678d312-8c1d-411d-9e1a-2a79e1b30f46 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6232024-11-06T00:30:47.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9678d312-8c1d-411d-9e1a-2a79e1b30f46 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6242024-11-06T00:30:49.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 595928d9-464b-412e-8cfd-4a458440dd65 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6252024-11-06T00:30:49.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 595928d9-464b-412e-8cfd-4a458440dd65 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6262024-11-06T00:30:49.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 595928d9-464b-412e-8cfd-4a458440dd65 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6272024-11-06T00:30:50.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ce156e8b-24e4-4e4d-a529-65bd58aba30d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6282024-11-06T00:30:50.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ce156e8b-24e4-4e4d-a529-65bd58aba30d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6292024-11-06T00:30:50.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ce156e8b-24e4-4e4d-a529-65bd58aba30d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6302024-11-06T00:30:51.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 297d4ef0-aa40-46c7-9df9-33b3a93634a6 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6312024-11-06T00:30:51.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 297d4ef0-aa40-46c7-9df9-33b3a93634a6 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6322024-11-06T00:30:51.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 297d4ef0-aa40-46c7-9df9-33b3a93634a6 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6332024-11-06T00:30:52.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8ecf7b58-e92f-455e-8f2a-7aecbb6de5e1 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6342024-11-06T00:30:52.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8ecf7b58-e92f-455e-8f2a-7aecbb6de5e1 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6352024-11-06T00:30:52.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8ecf7b58-e92f-455e-8f2a-7aecbb6de5e1 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6362024-11-06T00:30:53.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4f5358ff-fd3c-4f04-8e63-786063ad2a8b roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6372024-11-06T00:30:53.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4f5358ff-fd3c-4f04-8e63-786063ad2a8b resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6382024-11-06T00:30:53.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4f5358ff-fd3c-4f04-8e63-786063ad2a8b response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6392024-11-06T00:30:54.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 443f7b9c-d7dc-43e5-9489-cecbfc2368b5 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6402024-11-06T00:30:54.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 443f7b9c-d7dc-43e5-9489-cecbfc2368b5 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6412024-11-06T00:30:54.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 443f7b9c-d7dc-43e5-9489-cecbfc2368b5 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6422024-11-06T00:30:55.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9dc315d5-ad87-48ee-8004-c7b81fc5a73c roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6432024-11-06T00:30:55.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9dc315d5-ad87-48ee-8004-c7b81fc5a73c resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6442024-11-06T00:30:55.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9dc315d5-ad87-48ee-8004-c7b81fc5a73c response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
6452024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
6462024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
6472024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6482024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
6492024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6502024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
6512024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6522024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
6532024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6542024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
6552024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6562024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
6572024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
6582024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
6592024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6602024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6612024-11-06T00:30:55.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6622024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6632024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6642024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6652024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6662024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6672024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6682024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6692024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6702024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
6712024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
6722024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6732024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.63\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6742024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
6752024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
6762024-11-06T00:30:55.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.43\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
6772024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6782024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
6792024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
6802024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6812024-11-06T00:30:55.496ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6822024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.65\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
6832024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
6842024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6852024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 3.8\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6862024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
6872024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6882024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6892024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6902024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6912024-11-06T00:30:55.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6922024-11-06T00:30:55.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6932024-11-06T00:30:55.498ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1718, tv_nsec: 845322233 } })
6942024-11-06T00:30:55.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6952024-11-06T00:30:55.498ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.165384ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6962024-11-06T00:30:55.499ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
6972024-11-06T00:30:55.499ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1718, tv_nsec: 845763215 } })
6982024-11-06T00:30:55.499ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
6992024-11-06T00:30:55.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7002024-11-06T00:30:55.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7012024-11-06T00:30:55.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7022024-11-06T00:30:55.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7032024-11-06T00:30:55.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7042024-11-06T00:30:55.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7052024-11-06T00:30:55.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7062024-11-06T00:30:55.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7072024-11-06T00:30:55.503ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7082024-11-06T00:30:55.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7092024-11-06T00:30:55.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7102024-11-06T00:30:55.504ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7112024-11-06T00:30:55.504ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7122024-11-06T00:30:55.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7132024-11-06T00:30:55.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7142024-11-06T00:30:55.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7152024-11-06T00:30:55.505ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7162024-11-06T00:30:55.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7172024-11-06T00:30:55.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7182024-11-06T00:30:55.505ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7192024-11-06T00:30:55.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7202024-11-06T00:30:55.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7212024-11-06T00:30:55.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7222024-11-06T00:30:55.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7232024-11-06T00:30:55.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7242024-11-06T00:30:55.508ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1718, tv_nsec: 855489484 } })
7252024-11-06T00:30:55.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7262024-11-06T00:30:55.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7272024-11-06T00:30:55.509ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
7282024-11-06T00:30:55.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7292024-11-06T00:30:55.510ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7302024-11-06T00:30:55.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7312024-11-06T00:30:55.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7322024-11-06T00:30:55.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
7332024-11-06T00:30:55.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7342024-11-06T00:30:55.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7352024-11-06T00:30:55.514ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7362024-11-06T00:30:55.514ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.85993ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7372024-11-06T00:30:55.525ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
7382024-11-06T00:30:55.525ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.366621ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
7392024-11-06T00:30:55.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7402024-11-06T00:30:55.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7412024-11-06T00:30:55.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7422024-11-06T00:30:55.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7432024-11-06T00:30:55.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7442024-11-06T00:30:55.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7452024-11-06T00:30:55.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7462024-11-06T00:30:55.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7472024-11-06T00:30:55.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7482024-11-06T00:30:55.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7492024-11-06T00:30:55.549ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7502024-11-06T00:30:55.549ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7512024-11-06T00:30:55.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7522024-11-06T00:30:55.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7532024-11-06T00:30:55.589ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7542024-11-06T00:30:55.589ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7552024-11-06T00:30:55.590ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccec3e6e-89cd-48c3-bf2b-7c26dfac4916", "content-length": "26", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
7562024-11-06T00:30:55.590ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7572024-11-06T00:30:55.592ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7582024-11-06T00:30:55.593ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7592024-11-06T00:30:55.593ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7602024-11-06T00:30:55.594ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63f846c4-fc81-428c-bcc2-dca9bd9ac1ec", "content-length": "26", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
7612024-11-06T00:30:55.594ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7622024-11-06T00:30:55.595ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7632024-11-06T00:30:55.597ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
7642024-11-06T00:30:55.597ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7652024-11-06T00:30:55.597ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b46a2ed-0ccc-44ef-bf49-6826b34b547e", "content-length": "26", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
7662024-11-06T00:30:55.597ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7672024-11-06T00:30:55.599ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
7682024-11-06T00:30:55.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7692024-11-06T00:30:55.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7702024-11-06T00:30:55.605ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7712024-11-06T00:30:55.605ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7722024-11-06T00:30:55.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7732024-11-06T00:30:55.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7742024-11-06T00:30:55.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7752024-11-06T00:30:55.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7762024-11-06T00:30:55.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7772024-11-06T00:30:55.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7782024-11-06T00:30:55.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7792024-11-06T00:30:55.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7802024-11-06T00:30:55.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7812024-11-06T00:30:55.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
7822024-11-06T00:30:55.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7832024-11-06T00:30:55.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7842024-11-06T00:30:55.616ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.676262ms iteration = 24 status = 0
7852024-11-06T00:30:55.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 142.363416ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7862024-11-06T00:30:55.640ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7872024-11-06T00:30:55.640ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7882024-11-06T00:30:55.640ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.49338ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7892024-11-06T00:30:55.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 150.25718ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7902024-11-06T00:30:55.670ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2118be66-4ff0-49b8-a4d8-cae1881d9baf", "content-length": "372", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
7912024-11-06T00:30:55.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7922024-11-06T00:30:55.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7932024-11-06T00:30:55.672ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 177.685575ms iteration = 24 status = {}
7942024-11-06T00:30:55.676ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7952024-11-06T00:30:55.676ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4fe5035-08fd-4d5b-8ab1-f6ba83a021ec", "content-length": "1", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
7962024-11-06T00:30:55.678ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7972024-11-06T00:30:55.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7982024-11-06T00:30:55.680ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 185.675872ms iteration = 24 status = null
7992024-11-06T00:30:55.705ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 210.498799ms iteration = 27 status = {"physical_disks_added":0}
8002024-11-06T00:30:55.707ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8012024-11-06T00:30:55.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8022024-11-06T00:30:55.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8032024-11-06T00:30:55.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8042024-11-06T00:30:55.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8052024-11-06T00:30:55.711ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8062024-11-06T00:30:55.711ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8072024-11-06T00:30:55.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8082024-11-06T00:30:55.711ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c235466a-10bf-42a7-8f51-ff93fd29ae05", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
8092024-11-06T00:30:55.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8102024-11-06T00:30:55.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8112024-11-06T00:30:55.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8122024-11-06T00:30:55.714ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8132024-11-06T00:30:55.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8142024-11-06T00:30:55.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8152024-11-06T00:30:55.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8162024-11-06T00:30:55.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8172024-11-06T00:30:55.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8182024-11-06T00:30:55.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8192024-11-06T00:30:55.720ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8202024-11-06T00:30:55.720ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8212024-11-06T00:30:55.720ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a1c47c6f-9c3c-40b6-9fbf-d5d24747f34d", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
8222024-11-06T00:30:55.722ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 226.546295ms iteration = 24 status = {}
8232024-11-06T00:30:55.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8242024-11-06T00:30:55.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8252024-11-06T00:30:55.745ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
8262024-11-06T00:30:55.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8272024-11-06T00:30:55.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8282024-11-06T00:30:55.752ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8292024-11-06T00:30:55.752ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "04abf691-ba4b-4617-888a-710a7baab518", "content-length": "691", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
8302024-11-06T00:30:55.752ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8312024-11-06T00:30:55.752ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8322024-11-06T00:30:55.752ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8332024-11-06T00:30:55.753ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 258.648309ms iteration = 24 status = {}
8342024-11-06T00:30:55.754ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8352024-11-06T00:30:55.755ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "107ee8b7-ed56-4e2a-9c27-b901828c7912", "content-length": "121", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
8362024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
8372024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
8382024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8392024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8402024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8412024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8422024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8432024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8442024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8452024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8462024-11-06T00:30:55.755ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
8472024-11-06T00:30:55.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8482024-11-06T00:30:55.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8492024-11-06T00:30:55.758ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8502024-11-06T00:30:55.758ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f158a37-2716-4d80-9b1c-12211fecb4bf", "content-length": "2", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
8512024-11-06T00:30:55.758ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8522024-11-06T00:30:55.758ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3d23fdf-b5af-46b9-8b24-f74e217b81fb", "content-length": "52", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
8532024-11-06T00:30:55.758ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
8542024-11-06T00:30:55.758ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8552024-11-06T00:30:55.892ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3bd3e079-7544-4dff-9baa-3ddc7d85c804", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
8562024-11-06T00:30:55.892ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
8572024-11-06T00:30:55.892ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8582024-11-06T00:30:55.894ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fc13fa5-b99c-4926-b7ac-023eab1fbd1b", "content-length": "669", "date": "Wed, 06 Nov 2024 00:30:55 GMT"} })
8592024-11-06T00:30:55.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8602024-11-06T00:30:55.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8612024-11-06T00:30:55.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8622024-11-06T00:30:55.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8632024-11-06T00:30:55.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8642024-11-06T00:30:55.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8652024-11-06T00:30:55.912ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8662024-11-06T00:30:55.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8672024-11-06T00:30:55.920ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 425.45333ms iteration = 24 status = {}
8682024-11-06T00:30:56.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = e0b78283-d9ae-450f-8b58-a2c27389ba6d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8692024-11-06T00:30:56.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = e0b78283-d9ae-450f-8b58-a2c27389ba6d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8702024-11-06T00:30:56.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = e0b78283-d9ae-450f-8b58-a2c27389ba6d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8712024-11-06T00:30:56.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 58af4429-0f82-4b8f-9b35-708d2b02759d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8722024-11-06T00:30:56.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 58af4429-0f82-4b8f-9b35-708d2b02759d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8732024-11-06T00:30:56.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 58af4429-0f82-4b8f-9b35-708d2b02759d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8742024-11-06T00:30:57.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5068b4ce-adf9-491c-bfb6-3a7dd974eb71 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8752024-11-06T00:30:57.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5068b4ce-adf9-491c-bfb6-3a7dd974eb71 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8762024-11-06T00:30:57.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5068b4ce-adf9-491c-bfb6-3a7dd974eb71 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8772024-11-06T00:30:58.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4ba16bc9-f75a-4e6c-918b-6c61cab70b9b roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8782024-11-06T00:30:58.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4ba16bc9-f75a-4e6c-918b-6c61cab70b9b resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8792024-11-06T00:30:58.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4ba16bc9-f75a-4e6c-918b-6c61cab70b9b response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8802024-11-06T00:30:59.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cc8967bd-4b73-42c2-90e1-854adbb82a2a roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8812024-11-06T00:30:59.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cc8967bd-4b73-42c2-90e1-854adbb82a2a resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8822024-11-06T00:30:59.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cc8967bd-4b73-42c2-90e1-854adbb82a2a response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8832024-11-06T00:31:00.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 1688f04b-6edf-4bfd-8816-c7585e8cfccd roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8842024-11-06T00:31:00.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 1688f04b-6edf-4bfd-8816-c7585e8cfccd resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8852024-11-06T00:31:00.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 1688f04b-6edf-4bfd-8816-c7585e8cfccd response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8862024-11-06T00:31:01.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3f68fb80-bd78-4745-a128-aebb1bbe0457 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8872024-11-06T00:31:01.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3f68fb80-bd78-4745-a128-aebb1bbe0457 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8882024-11-06T00:31:01.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3f68fb80-bd78-4745-a128-aebb1bbe0457 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8892024-11-06T00:31:01.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 983 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = ad159025-c106-4945-8e75-d4ef08f3472e response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
8902024-11-06T00:31:02.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f880b54e-ac70-40c6-ab62-9d7d63454a2d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8912024-11-06T00:31:02.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f880b54e-ac70-40c6-ab62-9d7d63454a2d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8922024-11-06T00:31:02.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f880b54e-ac70-40c6-ab62-9d7d63454a2d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8932024-11-06T00:31:03.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e2edd5f0-6b8c-4f05-91af-6503ffcb7665 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8942024-11-06T00:31:03.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e2edd5f0-6b8c-4f05-91af-6503ffcb7665 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8952024-11-06T00:31:03.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e2edd5f0-6b8c-4f05-91af-6503ffcb7665 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8962024-11-06T00:31:04.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 00fd8fb3-c8d0-415c-9b09-76e2abc57063 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8972024-11-06T00:31:04.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 00fd8fb3-c8d0-415c-9b09-76e2abc57063 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8982024-11-06T00:31:04.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 00fd8fb3-c8d0-415c-9b09-76e2abc57063 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
8992024-11-06T00:31:05.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c62bd2a7-013c-4794-9136-74206b4acc0c roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9002024-11-06T00:31:05.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c62bd2a7-013c-4794-9136-74206b4acc0c resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9012024-11-06T00:31:05.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c62bd2a7-013c-4794-9136-74206b4acc0c response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9022024-11-06T00:31:05.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
9032024-11-06T00:31:05.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9042024-11-06T00:31:05.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9052024-11-06T00:31:05.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9062024-11-06T00:31:05.496ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
9072024-11-06T00:31:05.496ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9082024-11-06T00:31:05.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9092024-11-06T00:31:05.498ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9102024-11-06T00:31:05.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9112024-11-06T00:31:05.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9122024-11-06T00:31:05.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9132024-11-06T00:31:05.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9142024-11-06T00:31:05.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.643278ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9152024-11-06T00:31:05.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9162024-11-06T00:31:05.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9172024-11-06T00:31:05.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9182024-11-06T00:31:05.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
9192024-11-06T00:31:05.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9202024-11-06T00:31:05.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9212024-11-06T00:31:05.513ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
9222024-11-06T00:31:05.513ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.771487ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
9232024-11-06T00:31:06.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = af8b6997-e601-471f-9685-dd0c9ff2c4bd roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9242024-11-06T00:31:06.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = af8b6997-e601-471f-9685-dd0c9ff2c4bd resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9252024-11-06T00:31:06.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = af8b6997-e601-471f-9685-dd0c9ff2c4bd response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9262024-11-06T00:31:07.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9811e055-0837-408f-90b4-c40493efb3e8 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9272024-11-06T00:31:07.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9811e055-0837-408f-90b4-c40493efb3e8 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9282024-11-06T00:31:07.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9811e055-0837-408f-90b4-c40493efb3e8 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9292024-11-06T00:31:08.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 44935bba-1782-4c89-8e97-07b9ea1d4350 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9302024-11-06T00:31:08.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 44935bba-1782-4c89-8e97-07b9ea1d4350 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9312024-11-06T00:31:08.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 44935bba-1782-4c89-8e97-07b9ea1d4350 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9322024-11-06T00:31:09.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8aa9efa5-e1bf-414c-afcb-43c7cd0e7b97 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9332024-11-06T00:31:09.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8aa9efa5-e1bf-414c-afcb-43c7cd0e7b97 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9342024-11-06T00:31:09.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8aa9efa5-e1bf-414c-afcb-43c7cd0e7b97 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9352024-11-06T00:31:10.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0473db20-fbfe-4dba-a1c0-f949efb1ade7 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9362024-11-06T00:31:10.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0473db20-fbfe-4dba-a1c0-f949efb1ade7 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9372024-11-06T00:31:10.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0473db20-fbfe-4dba-a1c0-f949efb1ade7 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9382024-11-06T00:31:11.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 42970396-2c2e-400e-a6a5-b0c6388de3e9 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9392024-11-06T00:31:11.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 42970396-2c2e-400e-a6a5-b0c6388de3e9 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9402024-11-06T00:31:11.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 42970396-2c2e-400e-a6a5-b0c6388de3e9 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9412024-11-06T00:31:12.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = b9299b7a-b0d1-4bfe-b9b9-fc5483009aaa roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9422024-11-06T00:31:12.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = b9299b7a-b0d1-4bfe-b9b9-fc5483009aaa resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9432024-11-06T00:31:12.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = b9299b7a-b0d1-4bfe-b9b9-fc5483009aaa response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9442024-11-06T00:31:13.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cfe8e59a-5a6a-4650-bc1b-57d63714cea4 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9452024-11-06T00:31:13.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cfe8e59a-5a6a-4650-bc1b-57d63714cea4 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9462024-11-06T00:31:13.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cfe8e59a-5a6a-4650-bc1b-57d63714cea4 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9472024-11-06T00:31:14.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cfdc3d44-5462-40c6-b2e8-bac44b834043 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9482024-11-06T00:31:14.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cfdc3d44-5462-40c6-b2e8-bac44b834043 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9492024-11-06T00:31:14.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = cfdc3d44-5462-40c6-b2e8-bac44b834043 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9502024-11-06T00:31:15.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
9512024-11-06T00:31:15.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9522024-11-06T00:31:15.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9532024-11-06T00:31:15.496ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
9542024-11-06T00:31:15.496ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9552024-11-06T00:31:15.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9562024-11-06T00:31:15.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9572024-11-06T00:31:15.498ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9582024-11-06T00:31:15.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9592024-11-06T00:31:15.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9602024-11-06T00:31:15.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9612024-11-06T00:31:15.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9622024-11-06T00:31:15.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.589457ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9632024-11-06T00:31:15.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9642024-11-06T00:31:15.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9652024-11-06T00:31:15.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9662024-11-06T00:31:15.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
9672024-11-06T00:31:15.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9682024-11-06T00:31:15.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9692024-11-06T00:31:15.513ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
9702024-11-06T00:31:15.513ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.400266ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
9712024-11-06T00:31:15.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ea89f325-efc3-4809-9a31-2cd68e429839 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9722024-11-06T00:31:15.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ea89f325-efc3-4809-9a31-2cd68e429839 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9732024-11-06T00:31:15.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ea89f325-efc3-4809-9a31-2cd68e429839 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9742024-11-06T00:31:16.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 637 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = 1d3c07a4-f124-4af8-b3e8-37e750a9f5fe response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
9752024-11-06T00:31:16.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d453b073-51aa-4f29-83b1-73df698469e3 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9762024-11-06T00:31:16.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d453b073-51aa-4f29-83b1-73df698469e3 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9772024-11-06T00:31:16.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d453b073-51aa-4f29-83b1-73df698469e3 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9782024-11-06T00:31:17.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 476e8e3b-7bbf-4999-8ac6-a146309a20e2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
9792024-11-06T00:31:17.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 476e8e3b-7bbf-4999-8ac6-a146309a20e2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
9802024-11-06T00:31:17.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 476e8e3b-7bbf-4999-8ac6-a146309a20e2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
9812024-11-06T00:31:17.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = fcc0cd94-2049-4c9f-9500-78368c90de4e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
9822024-11-06T00:31:17.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = fcc0cd94-2049-4c9f-9500-78368c90de4e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
9832024-11-06T00:31:17.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = fcc0cd94-2049-4c9f-9500-78368c90de4e response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
9842024-11-06T00:31:17.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6b525da5-0c32-477f-887a-592d4ed7d01d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9852024-11-06T00:31:17.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6b525da5-0c32-477f-887a-592d4ed7d01d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9862024-11-06T00:31:17.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6b525da5-0c32-477f-887a-592d4ed7d01d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9872024-11-06T00:31:18.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 89ef2c7d-7859-4901-b48b-852eb3a78fb3 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9882024-11-06T00:31:18.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 89ef2c7d-7859-4901-b48b-852eb3a78fb3 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9892024-11-06T00:31:18.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 89ef2c7d-7859-4901-b48b-852eb3a78fb3 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9902024-11-06T00:31:19.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 08535af1-7e63-49c4-89fd-b911b614313d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9912024-11-06T00:31:19.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 08535af1-7e63-49c4-89fd-b911b614313d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9922024-11-06T00:31:19.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 08535af1-7e63-49c4-89fd-b911b614313d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9932024-11-06T00:31:20.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9d3df758-73e5-4075-a835-22bc38e925ea roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9942024-11-06T00:31:20.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9d3df758-73e5-4075-a835-22bc38e925ea resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9952024-11-06T00:31:20.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9d3df758-73e5-4075-a835-22bc38e925ea response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9962024-11-06T00:31:21.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c6b427e0-c165-40f5-8d17-457f01ffe8c6 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9972024-11-06T00:31:21.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c6b427e0-c165-40f5-8d17-457f01ffe8c6 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9982024-11-06T00:31:21.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c6b427e0-c165-40f5-8d17-457f01ffe8c6 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
9992024-11-06T00:31:22.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 66e8b45b-d9e2-418f-a0ce-a77303c3d63a roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
10002024-11-06T00:31:22.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 66e8b45b-d9e2-418f-a0ce-a77303c3d63a resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
10012024-11-06T00:31:22.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 66e8b45b-d9e2-418f-a0ce-a77303c3d63a response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
10022024-11-06T00:31:23.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8092cd85-6549-4cd3-a672-6b55c4cdc882 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
10032024-11-06T00:31:23.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8092cd85-6549-4cd3-a672-6b55c4cdc882 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
10042024-11-06T00:31:23.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8092cd85-6549-4cd3-a672-6b55c4cdc882 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
10052024-11-06T00:31:24.984ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524 remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 69f50d2f-34e4-499f-b0dc-25520293270b uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-06T00:31:24.957357886Z }
10062024-11-06T00:31:24.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 69f50d2f-34e4-499f-b0dc-25520293270b roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
10072024-11-06T00:31:24.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 69f50d2f-34e4-499f-b0dc-25520293270b resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
10082024-11-06T00:31:25.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52054 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 69f50d2f-34e4-499f-b0dc-25520293270b response_code = 204 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
10092024-11-06T00:31:25.010ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524 remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 04eae7e5-757d-4069-ac88-176e62828095 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-06T00:31:25.010128022Z }
10102024-11-06T00:31:25.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 04eae7e5-757d-4069-ac88-176e62828095 roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
10112024-11-06T00:31:25.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 04eae7e5-757d-4069-ac88-176e62828095 resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
10122024-11-06T00:31:25.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11060 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 04eae7e5-757d-4069-ac88-176e62828095 response_code = 204 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
10132024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
10142024-11-06T00:31:25.494ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:21:25.494674508 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10152024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
10162024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10172024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
10182024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10192024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10202024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10212024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
10222024-11-06T00:31:25.494ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
10232024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.48\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
10242024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
10252024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
10262024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
10272024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
10282024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10292024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10302024-11-06T00:31:25.494ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
10312024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
10322024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10332024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10342024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
10352024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
10362024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10372024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
10382024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10392024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
10402024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10412024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
10422024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
10432024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
10442024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10452024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10462024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
10472024-11-06T00:31:25.495ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10482024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10492024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
10502024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
10512024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10522024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10532024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10542024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10552024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10562024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10572024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10582024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10592024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10602024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
10612024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
10622024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10632024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.72\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10642024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.221\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
10652024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
10662024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10672024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
10682024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
10692024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10702024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10712024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10722024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
10732024-11-06T00:31:25.495ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10742024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
10752024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10762024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10772024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.461\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10782024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
10792024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
10802024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10812024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10822024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
10832024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10842024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.5\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
10852024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
10862024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10872024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10882024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10892024-11-06T00:31:25.495ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1748, tv_nsec: 842346714 } })
10902024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10912024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10922024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10932024-11-06T00:31:25.495ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1748, tv_nsec: 842437057 } })
10942024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10952024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10962024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10972024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10982024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10992024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11002024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11012024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11022024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11032024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11042024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11052024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
11062024-11-06T00:31:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.230237ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
11072024-11-06T00:31:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11082024-11-06T00:31:25.496ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11092024-11-06T00:31:25.496ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
11102024-11-06T00:31:25.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.387231ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
11112024-11-06T00:31:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11122024-11-06T00:31:25.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11132024-11-06T00:31:25.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11142024-11-06T00:31:25.497ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:21:25.494674508 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11152024-11-06T00:31:25.497ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.643159ms iteration = 13 status = {"expiration":"2024-11-06T00:21:25.494674508Z","pruned":[]}
11162024-11-06T00:31:25.497ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11172024-11-06T00:31:25.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11182024-11-06T00:31:25.498ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.34286ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11192024-11-06T00:31:25.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11202024-11-06T00:31:25.499ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11212024-11-06T00:31:25.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11222024-11-06T00:31:25.500ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11232024-11-06T00:31:25.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242024-11-06T00:31:25.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11252024-11-06T00:31:25.502ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11262024-11-06T00:31:25.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11272024-11-06T00:31:25.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11282024-11-06T00:31:25.503ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11292024-11-06T00:31:25.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11302024-11-06T00:31:25.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11312024-11-06T00:31:25.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11322024-11-06T00:31:25.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11332024-11-06T00:31:25.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11342024-11-06T00:31:25.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11352024-11-06T00:31:25.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11362024-11-06T00:31:25.503ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11372024-11-06T00:31:25.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11382024-11-06T00:31:25.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11392024-11-06T00:31:25.504ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11402024-11-06T00:31:25.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412024-11-06T00:31:25.506ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1748, tv_nsec: 852941229 } })
11422024-11-06T00:31:25.506ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
11432024-11-06T00:31:25.507ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1748, tv_nsec: 853937088 } })
11442024-11-06T00:31:25.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11452024-11-06T00:31:25.507ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11462024-11-06T00:31:25.507ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
11472024-11-06T00:31:25.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11482024-11-06T00:31:25.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11492024-11-06T00:31:25.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11502024-11-06T00:31:25.508ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11512024-11-06T00:31:25.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11522024-11-06T00:31:25.510ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.015516ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
11532024-11-06T00:31:25.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11542024-11-06T00:31:25.510ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11552024-11-06T00:31:25.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11562024-11-06T00:31:25.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11572024-11-06T00:31:25.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11582024-11-06T00:31:25.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11592024-11-06T00:31:25.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11602024-11-06T00:31:25.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11612024-11-06T00:31:25.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11622024-11-06T00:31:25.515ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11632024-11-06T00:31:25.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11642024-11-06T00:31:25.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11652024-11-06T00:31:25.518ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11662024-11-06T00:31:25.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11672024-11-06T00:31:25.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11682024-11-06T00:31:25.521ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11692024-11-06T00:31:25.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11702024-11-06T00:31:25.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11712024-11-06T00:31:25.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11722024-11-06T00:31:25.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11732024-11-06T00:31:25.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11742024-11-06T00:31:25.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11752024-11-06T00:31:25.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11762024-11-06T00:31:25.528ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1748, tv_nsec: 875559500 } })
11772024-11-06T00:31:25.529ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
11782024-11-06T00:31:25.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11792024-11-06T00:31:25.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11802024-11-06T00:31:25.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11812024-11-06T00:31:25.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11822024-11-06T00:31:25.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11832024-11-06T00:31:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
11842024-11-06T00:31:25.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11852024-11-06T00:31:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11862024-11-06T00:31:25.548ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11872024-11-06T00:31:25.548ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11882024-11-06T00:31:25.548ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 53.080966ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11892024-11-06T00:31:25.549ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11902024-11-06T00:31:25.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11912024-11-06T00:31:25.551ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11922024-11-06T00:31:25.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11932024-11-06T00:31:25.552ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11942024-11-06T00:31:25.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11952024-11-06T00:31:25.556ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11962024-11-06T00:31:25.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11972024-11-06T00:31:25.556ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
11982024-11-06T00:31:25.556ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.97979ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
11992024-11-06T00:31:25.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12002024-11-06T00:31:25.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12012024-11-06T00:31:25.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12022024-11-06T00:31:25.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12032024-11-06T00:31:25.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12042024-11-06T00:31:25.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12052024-11-06T00:31:25.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12062024-11-06T00:31:25.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12072024-11-06T00:31:25.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12082024-11-06T00:31:25.564ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12092024-11-06T00:31:25.564ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12102024-11-06T00:31:25.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12112024-11-06T00:31:25.566ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12122024-11-06T00:31:25.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12132024-11-06T00:31:25.566ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12142024-11-06T00:31:25.566ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12152024-11-06T00:31:25.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12162024-11-06T00:31:25.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12172024-11-06T00:31:25.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12182024-11-06T00:31:25.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
12192024-11-06T00:31:25.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12202024-11-06T00:31:25.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12212024-11-06T00:31:25.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.233054ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12222024-11-06T00:31:25.569ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 75.107049ms iteration = 6 status = {"nsuccess":5}
12232024-11-06T00:31:25.572ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12242024-11-06T00:31:25.572ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12252024-11-06T00:31:25.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12262024-11-06T00:31:25.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12272024-11-06T00:31:25.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12282024-11-06T00:31:25.575ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.792349ms iteration = 25 status = 0
12292024-11-06T00:31:25.576ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12302024-11-06T00:31:25.577ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12312024-11-06T00:31:25.577ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12322024-11-06T00:31:25.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12332024-11-06T00:31:25.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12342024-11-06T00:31:25.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12352024-11-06T00:31:25.579ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12362024-11-06T00:31:25.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12372024-11-06T00:31:25.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12382024-11-06T00:31:25.582ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12392024-11-06T00:31:25.582ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
12402024-11-06T00:31:25.582ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.236579ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
12412024-11-06T00:31:25.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12422024-11-06T00:31:25.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12432024-11-06T00:31:25.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12442024-11-06T00:31:25.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12452024-11-06T00:31:25.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12462024-11-06T00:31:25.592ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 97.375631ms iteration = 28 status = {"physical_disks_added":0}
12472024-11-06T00:31:25.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.939157ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12482024-11-06T00:31:25.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12492024-11-06T00:31:25.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12502024-11-06T00:31:25.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12512024-11-06T00:31:25.595ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12522024-11-06T00:31:25.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12532024-11-06T00:31:25.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12542024-11-06T00:31:25.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12552024-11-06T00:31:25.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12562024-11-06T00:31:25.606ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12572024-11-06T00:31:25.606ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12582024-11-06T00:31:25.606ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12592024-11-06T00:31:25.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12602024-11-06T00:31:25.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12612024-11-06T00:31:25.610ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12622024-11-06T00:31:25.610ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12632024-11-06T00:31:25.610ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.927601ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12642024-11-06T00:31:25.615ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
12652024-11-06T00:31:25.623ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12662024-11-06T00:31:25.628ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
12672024-11-06T00:31:25.628ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12682024-11-06T00:31:25.629ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4077bff0-40f8-4225-85ac-9922276d7311", "content-length": "26", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} })
12692024-11-06T00:31:25.629ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12702024-11-06T00:31:25.630ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12712024-11-06T00:31:25.649ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
12722024-11-06T00:31:25.649ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12732024-11-06T00:31:25.649ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "464ab606-df7d-4680-99fa-521a4fe683fd", "content-length": "26", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} })
12742024-11-06T00:31:25.649ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12752024-11-06T00:31:25.651ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12762024-11-06T00:31:25.662ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
12772024-11-06T00:31:25.662ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12782024-11-06T00:31:25.662ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a2f1b69-7fc3-4e49-80b7-2b9be84007d4", "content-length": "26", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} })
12792024-11-06T00:31:25.662ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12802024-11-06T00:31:25.663ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
12812024-11-06T00:31:25.755ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524/state
12822024-11-06T00:31:25.756ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6acd157-9cc2-4d89-b940-55b7121feb48", "content-length": "130", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} })
12832024-11-06T00:31:25.756ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b sled_id = 7c647f25-eb29-494d-840d-11658133af45 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-06T00:31:25.010128022Z }, migration_in: None, migration_out: None } vmm_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524
12842024-11-06T00:31:25.756ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524 sled_id = 7c647f25-eb29-494d-840d-11658133af45 vmm_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-06T00:31:25.010128022Z }
12852024-11-06T00:31:25.756ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b roles = RoleSet { roles: {} } sled_id = 7c647f25-eb29-494d-840d-11658133af45 vmm_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524
12862024-11-06T00:31:25.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b resource = Database result = Ok(()) sled_id = 7c647f25-eb29-494d-840d-11658133af45 vmm_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524
12872024-11-06T00:31:25.757ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12882024-11-06T00:31:25.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12892024-11-06T00:31:25.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12902024-11-06T00:31:25.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12912024-11-06T00:31:25.760ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12922024-11-06T00:31:25.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12932024-11-06T00:31:25.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12942024-11-06T00:31:25.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12952024-11-06T00:31:25.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12962024-11-06T00:31:25.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12972024-11-06T00:31:25.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12982024-11-06T00:31:25.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12992024-11-06T00:31:25.786ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13002024-11-06T00:31:25.786ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
13012024-11-06T00:31:25.786ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13022024-11-06T00:31:25.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13032024-11-06T00:31:25.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13042024-11-06T00:31:25.789ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
13052024-11-06T00:31:25.790ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 295.506153ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
13062024-11-06T00:31:25.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13072024-11-06T00:31:25.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13082024-11-06T00:31:25.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13092024-11-06T00:31:25.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13102024-11-06T00:31:25.794ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
13112024-11-06T00:31:25.794ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13122024-11-06T00:31:25.794ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
13132024-11-06T00:31:25.794ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 299.79678ms iteration = 13 status = {"generation":2}
13142024-11-06T00:31:25.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13152024-11-06T00:31:25.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13162024-11-06T00:31:25.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13172024-11-06T00:31:25.795ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13182024-11-06T00:31:25.795ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13192024-11-06T00:31:25.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13202024-11-06T00:31:25.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13212024-11-06T00:31:25.802ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
13222024-11-06T00:31:25.802ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 307.740246ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13232024-11-06T00:31:25.817ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13242024-11-06T00:31:25.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13252024-11-06T00:31:25.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13262024-11-06T00:31:25.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13272024-11-06T00:31:25.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13282024-11-06T00:31:25.834ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13292024-11-06T00:31:25.834ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13302024-11-06T00:31:25.834ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
13312024-11-06T00:31:25.834ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 339.604013ms iteration = 13 status = {"generation":1}
13322024-11-06T00:31:25.865ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
13332024-11-06T00:31:25.865ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 369.973404ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
13342024-11-06T00:31:25.953ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
13352024-11-06T00:31:25.954ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8fb34cbd-e9e1-4bcf-a3b6-23cdde01c4c4", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13362024-11-06T00:31:25.954ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13372024-11-06T00:31:25.955ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7d3a1021-9a9f-4336-969a-315c0d9cabf7", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13382024-11-06T00:31:25.955ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13392024-11-06T00:31:25.958ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13402024-11-06T00:31:25.958ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 463.279294ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13412024-11-06T00:31:25.970ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13422024-11-06T00:31:25.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13432024-11-06T00:31:25.971ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9d6a087-cb91-4a44-8b10-48757fbe6570", "content-length": "583", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} })
13442024-11-06T00:31:25.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13452024-11-06T00:31:25.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13462024-11-06T00:31:25.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = b289bfdd-3f33-412d-9e79-132cb42c3680 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
13472024-11-06T00:31:25.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = b289bfdd-3f33-412d-9e79-132cb42c3680 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
13482024-11-06T00:31:26.015ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
13492024-11-06T00:31:26.016ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "62534c53-adfd-461a-9bdc-ac764b87bcc2", "date": "Wed, 06 Nov 2024 00:31:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13502024-11-06T00:31:26.016ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13512024-11-06T00:31:26.017ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "63beb03b-279f-4c90-bea0-1a35a4a0b795", "date": "Wed, 06 Nov 2024 00:31:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13522024-11-06T00:31:26.017ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13532024-11-06T00:31:26.019ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6a18c79d-0174-4efc-835f-caae3c1c9dbf", "date": "Wed, 06 Nov 2024 00:31:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13542024-11-06T00:31:26.019ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13552024-11-06T00:31:26.021ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13562024-11-06T00:31:26.021ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 526.330287ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13572024-11-06T00:31:26.035ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13582024-11-06T00:31:26.035ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "36054e3b-b0ca-4b96-97d1-81597f13f365", "content-length": "1", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} })
13592024-11-06T00:31:26.037ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 542.136175ms iteration = 25 status = {}
13602024-11-06T00:31:26.037ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13612024-11-06T00:31:26.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13622024-11-06T00:31:26.039ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13632024-11-06T00:31:26.040ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aad9986-4fd7-49f3-9064-8ade7dbb0fe2", "content-length": "810", "date": "Wed, 06 Nov 2024 00:31:26 GMT"} })
13642024-11-06T00:31:26.040ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(7291606) }} sled = sock
13652024-11-06T00:31:26.040ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
13662024-11-06T00:31:26.040ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
13672024-11-06T00:31:26.042ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 547.313849ms iteration = 25 status = {}
13682024-11-06T00:31:26.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = b289bfdd-3f33-412d-9e79-132cb42c3680 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
13692024-11-06T00:31:26.043ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 548.848795ms iteration = 25 status = null
13702024-11-06T00:31:26.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13712024-11-06T00:31:26.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13722024-11-06T00:31:26.074ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
13732024-11-06T00:31:26.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13742024-11-06T00:31:26.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13752024-11-06T00:31:26.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13762024-11-06T00:31:26.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3a8cc84-b295-471c-88a6-e772b38dd5e0", "content-length": "121", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} })
13772024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
13782024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
13792024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {d04c5890-48aa-4e4d-951b-e3f160bd3d6f: {10.151.2.176: {d0428e7e-a355-4d59-a4c2-aa33fa6b3090}, 10.151.2.175: {d0428e7e-a355-4d59-a4c2-aa33fa6b3090}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
13802024-11-06T00:31:26.084ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13812024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13822024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13832024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13842024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13852024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13862024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13872024-11-06T00:31:26.084ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e7260eb2-213a-4618-8a00-d69e5c1e1502", "date": "Wed, 06 Nov 2024 00:31:26 GMT"} })
13882024-11-06T00:31:26.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13892024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13902024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13912024-11-06T00:31:26.084ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
13922024-11-06T00:31:26.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13932024-11-06T00:31:26.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13942024-11-06T00:31:26.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13952024-11-06T00:31:26.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13962024-11-06T00:31:26.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "449394b6-854f-4f9f-a124-b23f736223f0", "content-length": "2", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} })
13972024-11-06T00:31:26.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13982024-11-06T00:31:26.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5309807f-5c8e-47fa-b14d-7a6d95be5522", "content-length": "52", "date": "Wed, 06 Nov 2024 00:31:25 GMT"} })
13992024-11-06T00:31:26.087ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
14002024-11-06T00:31:26.087ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14012024-11-06T00:31:26.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14022024-11-06T00:31:26.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14032024-11-06T00:31:26.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14042024-11-06T00:31:26.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14052024-11-06T00:31:26.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14062024-11-06T00:31:26.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14072024-11-06T00:31:26.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14082024-11-06T00:31:26.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14092024-11-06T00:31:26.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14102024-11-06T00:31:26.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14112024-11-06T00:31:26.103ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14122024-11-06T00:31:26.103ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14132024-11-06T00:31:26.103ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14142024-11-06T00:31:26.200ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e0cc9c30-cf4a-46d3-b999-88309d11f570", "date": "Wed, 06 Nov 2024 00:31:26 GMT"} })
14152024-11-06T00:31:26.200ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
14162024-11-06T00:31:26.200ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14172024-11-06T00:31:26.201ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "612ca547-c1f4-40e8-833d-cf8c82d1363a", "date": "Wed, 06 Nov 2024 00:31:26 GMT"} })
14182024-11-06T00:31:26.202ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 707.177046ms iteration = 25 status = {}
14192024-11-06T00:31:26.202ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fbc4037-5c3e-4ee5-916d-d0e137f16f86", "content-length": "669", "date": "Wed, 06 Nov 2024 00:31:26 GMT"} })
14202024-11-06T00:31:26.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14212024-11-06T00:31:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14222024-11-06T00:31:26.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14232024-11-06T00:31:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14242024-11-06T00:31:26.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14252024-11-06T00:31:26.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14262024-11-06T00:31:26.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14272024-11-06T00:31:26.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14282024-11-06T00:31:26.226ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 731.947551ms iteration = 25 status = {}
14292024-11-06T00:31:27.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7488a1a7-3c57-476e-8a35-f5b692f0e43e roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14302024-11-06T00:31:27.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7488a1a7-3c57-476e-8a35-f5b692f0e43e resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14312024-11-06T00:31:27.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7488a1a7-3c57-476e-8a35-f5b692f0e43e response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14322024-11-06T00:31:28.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 301f2e22-e863-4902-b965-80d70f8716cf roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14332024-11-06T00:31:28.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 301f2e22-e863-4902-b965-80d70f8716cf resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14342024-11-06T00:31:28.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 301f2e22-e863-4902-b965-80d70f8716cf response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14352024-11-06T00:31:29.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = acb1651d-6bd5-425b-a048-19d27a9a30a3 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14362024-11-06T00:31:29.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = acb1651d-6bd5-425b-a048-19d27a9a30a3 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14372024-11-06T00:31:29.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = acb1651d-6bd5-425b-a048-19d27a9a30a3 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14382024-11-06T00:31:30.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 18cf3039-02b0-4dd8-a1e2-4934a48fc49d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14392024-11-06T00:31:30.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 18cf3039-02b0-4dd8-a1e2-4934a48fc49d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14402024-11-06T00:31:30.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 18cf3039-02b0-4dd8-a1e2-4934a48fc49d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14412024-11-06T00:31:31.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 85465406-e4e7-4a7d-a7e3-9dde69697ec7 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14422024-11-06T00:31:31.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 85465406-e4e7-4a7d-a7e3-9dde69697ec7 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14432024-11-06T00:31:31.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 85465406-e4e7-4a7d-a7e3-9dde69697ec7 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14442024-11-06T00:31:31.472ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5408 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = 484bcfab-0145-4a57-8310-de1426291509 response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
14452024-11-06T00:31:32.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4c68290a-802a-48c1-ba5b-2a22e1bb2a76 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14462024-11-06T00:31:32.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4c68290a-802a-48c1-ba5b-2a22e1bb2a76 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14472024-11-06T00:31:32.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4c68290a-802a-48c1-ba5b-2a22e1bb2a76 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14482024-11-06T00:31:33.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8b2cb9a4-40a3-4076-a04d-4a83d17503fa roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14492024-11-06T00:31:33.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8b2cb9a4-40a3-4076-a04d-4a83d17503fa resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14502024-11-06T00:31:33.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8b2cb9a4-40a3-4076-a04d-4a83d17503fa response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14512024-11-06T00:31:34.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0bfdbf6a-74f9-457a-a1b3-f27b6bf2f149 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14522024-11-06T00:31:34.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0bfdbf6a-74f9-457a-a1b3-f27b6bf2f149 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14532024-11-06T00:31:34.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0bfdbf6a-74f9-457a-a1b3-f27b6bf2f149 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14542024-11-06T00:31:34.857ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524 remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4c1e79cc-7b11-4d88-8d16-9e9a2cc7c994 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-06T00:31:34.856929597Z }
14552024-11-06T00:31:34.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4c1e79cc-7b11-4d88-8d16-9e9a2cc7c994 roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
14562024-11-06T00:31:34.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4c1e79cc-7b11-4d88-8d16-9e9a2cc7c994 resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
14572024-11-06T00:31:34.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36888 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4c1e79cc-7b11-4d88-8d16-9e9a2cc7c994 response_code = 204 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
14582024-11-06T00:31:35.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = d30834f0-5f00-4872-b9c1-5d936ed72c16 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
14592024-11-06T00:31:35.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = d30834f0-5f00-4872-b9c1-5d936ed72c16 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
14602024-11-06T00:31:35.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = d30834f0-5f00-4872-b9c1-5d936ed72c16 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
14612024-11-06T00:31:35.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 2f576012-4fae-4ca7-ac41-6eb8974dd6f6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
14622024-11-06T00:31:35.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 2f576012-4fae-4ca7-ac41-6eb8974dd6f6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
14632024-11-06T00:31:35.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 2f576012-4fae-4ca7-ac41-6eb8974dd6f6 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
14642024-11-06T00:31:35.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 711712ec-07b1-476e-9af1-286b0e90e225 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14652024-11-06T00:31:35.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 711712ec-07b1-476e-9af1-286b0e90e225 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14662024-11-06T00:31:35.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 711712ec-07b1-476e-9af1-286b0e90e225 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14672024-11-06T00:31:35.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
14682024-11-06T00:31:35.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14692024-11-06T00:31:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14702024-11-06T00:31:35.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
14712024-11-06T00:31:35.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14722024-11-06T00:31:35.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14732024-11-06T00:31:35.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14742024-11-06T00:31:35.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14752024-11-06T00:31:35.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14762024-11-06T00:31:35.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14772024-11-06T00:31:35.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14782024-11-06T00:31:35.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14792024-11-06T00:31:35.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14802024-11-06T00:31:35.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
14812024-11-06T00:31:35.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14822024-11-06T00:31:35.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14832024-11-06T00:31:35.513ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
14842024-11-06T00:31:35.513ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.467398ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
14852024-11-06T00:31:35.523ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14862024-11-06T00:31:35.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14872024-11-06T00:31:35.551ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.296912ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14882024-11-06T00:31:36.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 689c00a9-5b54-4311-ac76-ec4c93599f7d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14892024-11-06T00:31:36.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 689c00a9-5b54-4311-ac76-ec4c93599f7d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14902024-11-06T00:31:36.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 689c00a9-5b54-4311-ac76-ec4c93599f7d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
14912024-11-06T00:31:36.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 17ee347a-0321-49b9-b604-9f1d4879af20 roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
14922024-11-06T00:31:36.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 17ee347a-0321-49b9-b604-9f1d4879af20 resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
14932024-11-06T00:31:36.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 17ee347a-0321-49b9-b604-9f1d4879af20 response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
14942024-11-06T00:31:36.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 69f18a99-f96b-4b6d-829c-55ee02317eba roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
14952024-11-06T00:31:36.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 69f18a99-f96b-4b6d-829c-55ee02317eba resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
14962024-11-06T00:31:36.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = 69f18a99-f96b-4b6d-829c-55ee02317eba response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
14972024-11-06T00:31:37.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 183f78e1-9c82-484a-857f-9b7b01a719b2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
14982024-11-06T00:31:37.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 183f78e1-9c82-484a-857f-9b7b01a719b2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
14992024-11-06T00:31:37.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 183f78e1-9c82-484a-857f-9b7b01a719b2 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
15002024-11-06T00:31:37.303ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524 remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-06T00:31:37.303435173Z }
15012024-11-06T00:31:37.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15022024-11-06T00:31:37.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15032024-11-06T00:31:37.313ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524 remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524 vmm_needs_update = true
15042024-11-06T00:31:37.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15052024-11-06T00:31:37.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15062024-11-06T00:31:37.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15072024-11-06T00:31:37.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15082024-11-06T00:31:37.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15092024-11-06T00:31:37.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15102024-11-06T00:31:37.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15112024-11-06T00:31:37.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15122024-11-06T00:31:37.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15132024-11-06T00:31:37.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15142024-11-06T00:31:37.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15152024-11-06T00:31:37.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15162024-11-06T00:31:37.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15172024-11-06T00:31:37.327ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: 6ce0f376-6379-45db-a017-9b7dfee5a397, lookup_type: ById(6ce0f376-6379-45db-a017-9b7dfee5a397) }, key: c7df1963-d43c-46bf-b3d4-6a37670b026b, lookup_type: ById(c7df1963-d43c-46bf-b3d4-6a37670b026b) } result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15182024-11-06T00:31:37.334ZINFOnexus (dropshot_internal): starting update saga for c7df1963-d43c-46bf-b3d4-6a37670b026b actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-06T00:31:37.303435173Z }
15192024-11-06T00:31:37.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31331 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 response_code = 204 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15202024-11-06T00:31:37.335ZDEBGnexus (dropshot_internal): preparing instance-update saga for c7df1963-d43c-46bf-b3d4-6a37670b026b... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 64d3293d-03f8-4a98-a1ed-2555b0776f66 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15212024-11-06T00:31:37.335ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update
15222024-11-06T00:31:37.337ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"c7df1963-d43c-46bf-b3d4-6a37670b026b","lookup_type":{"ById":"c7df1963-d43c-46bf-b3d4-6a37670b026b"},"parent":{"key":"6ce0f376-6379-45db-a017-9b7dfee5a397","lookup_type":{"ById":"6ce0f376-6379-45db-a017-9b7dfee5a397"},"parent":{"key":"538efd2f-b8ed-4a95-91b1-680b63627575","lookup_type":{"ById":"538efd2f-b8ed-4a95-91b1-680b63627575"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15232024-11-06T00:31:37.337ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update
15242024-11-06T00:31:37.337ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524 remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 18e75384-9ae4-4eeb-a5ab-810e33cfd16e uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-06T00:31:37.303435173Z }
15252024-11-06T00:31:37.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 18e75384-9ae4-4eeb-a5ab-810e33cfd16e roles = RoleSet { roles: {} } uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15262024-11-06T00:31:37.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 18e75384-9ae4-4eeb-a5ab-810e33cfd16e resource = Database result = Ok(()) uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15272024-11-06T00:31:37.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29546 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 18e75384-9ae4-4eeb-a5ab-810e33cfd16e response_code = 204 uri = /vmms/46330988-8b9f-455b-aa6c-07ae8d3bc524
15282024-11-06T00:31:37.377ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update
15292024-11-06T00:31:37.377ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15302024-11-06T00:31:37.377ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15312024-11-06T00:31:37.377ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
15322024-11-06T00:31:37.382ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15332024-11-06T00:31:37.382ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
15342024-11-06T00:31:37.385ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15352024-11-06T00:31:37.385ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
15362024-11-06T00:31:37.394ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15372024-11-06T00:31:37.394ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7")) node_id = 0 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
15382024-11-06T00:31:37.398ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15392024-11-06T00:31:37.398ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
15402024-11-06T00:31:37.422ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update
15412024-11-06T00:31:37.429ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15422024-11-06T00:31:37.429ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15432024-11-06T00:31:37.436ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15442024-11-06T00:31:37.436ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15452024-11-06T00:31:37.441ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15462024-11-06T00:31:37.442ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15472024-11-06T00:31:37.448ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15482024-11-06T00:31:37.448ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15492024-11-06T00:31:37.450ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15502024-11-06T00:31:37.450ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15512024-11-06T00:31:37.451ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15522024-11-06T00:31:37.452ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15532024-11-06T00:31:37.453ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15542024-11-06T00:31:37.456ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: 6ce0f376-6379-45db-a017-9b7dfee5a397, lookup_type: ById(6ce0f376-6379-45db-a017-9b7dfee5a397) }, key: c7df1963-d43c-46bf-b3d4-6a37670b026b, lookup_type: ById(c7df1963-d43c-46bf-b3d4-6a37670b026b) } result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15552024-11-06T00:31:37.456ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance updater_id = 8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7
15562024-11-06T00:31:37.456ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15572024-11-06T00:31:37.456ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15582024-11-06T00:31:37.473ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance updater_id = 8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7
15592024-11-06T00:31:37.473ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15602024-11-06T00:31:37.473ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance
15612024-11-06T00:31:37.478ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b locked_gen = Generation(Generation(2)) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = LockInstance updater_id = 8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7
15622024-11-06T00:31:37.478ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15632024-11-06T00:31:37.478ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7")}) node_id = 1 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
15642024-11-06T00:31:37.483ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15652024-11-06T00:31:37.483ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
15662024-11-06T00:31:37.486ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
15672024-11-06T00:31:37.486ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
15682024-11-06T00:31:37.487ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
15692024-11-06T00:31:37.487ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
15702024-11-06T00:31:37.488ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
15712024-11-06T00:31:37.488ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
15722024-11-06T00:31:37.490ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
15732024-11-06T00:31:37.493ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: 6ce0f376-6379-45db-a017-9b7dfee5a397, lookup_type: ById(6ce0f376-6379-45db-a017-9b7dfee5a397) }, key: c7df1963-d43c-46bf-b3d4-6a37670b026b, lookup_type: ById(c7df1963-d43c-46bf-b3d4-6a37670b026b) } result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
15742024-11-06T00:31:37.493ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
15752024-11-06T00:31:37.493ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
15762024-11-06T00:31:37.504ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 46330988-8b9f-455b-aa6c-07ae8d3bc524, time_created: 2024-11-06T00:31:16.609875Z, time_deleted: None, instance_id: c7df1963-d43c-46bf-b3d4-6a37670b026b, sled_id: 7c647f25-eb29-494d-840d-11658133af45, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-06T00:31:37.303435Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-06T00:31:14.067560Z, gen: Generation(Generation(3)), propolis_id: Some(46330988-8b9f-455b-aa6c-07ae8d3bc524), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(46330988-8b9f-455b-aa6c-07ae8d3bc524 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-06T00:31:37.502363399Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
15772024-11-06T00:31:37.514ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
15782024-11-06T00:31:37.514ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"c7df1963-d43c-46bf-b3d4-6a37670b026b","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"46330988-8b9f-455b-aa6c-07ae8d3bc524"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"c7df1963-d43c-46bf-b3d4-6a37670b026b","lookup_type":{"ById":"c7df1963-d43c-46bf-b3d4-6a37670b026b"},"parent":{"key":"6ce0f376-6379-45db-a017-9b7dfee5a397","lookup_type":{"ById":"6ce0f376-6379-45db-a017-9b7dfee5a397"},"parent":{"key":"538efd2f-b8ed-4a95-91b1-680b63627575","lookup_type":{"ById":"538efd2f-b8ed-4a95-91b1-680b63627575"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"6ce0f376-6379-45db-a017-9b7dfee5a397","ram_diff":1073741824},"destroy_active_vmm":"46330988-8b9f-455b-aa6c-07ae8d3bc524","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-06T00:31:37.502363399Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15792024-11-06T00:31:37.514ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
15802024-11-06T00:31:37.550ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
15812024-11-06T00:31:37.550ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15822024-11-06T00:31:37.550ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15832024-11-06T00:31:37.550ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
15842024-11-06T00:31:37.554ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15852024-11-06T00:31:37.554ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
15862024-11-06T00:31:37.558ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15872024-11-06T00:31:37.558ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
15882024-11-06T00:31:37.562ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15892024-11-06T00:31:37.562ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d5941105-18c0-460d-9a0c-460a0a7e463a")) node_id = 0 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
15902024-11-06T00:31:37.566ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15912024-11-06T00:31:37.566ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
15922024-11-06T00:31:37.572ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b parent_lock = UpdaterLock { updater_id: 8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7, locked_gen: Generation(Generation(2)) } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
15932024-11-06T00:31:37.572ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = BecomeUpdater
15942024-11-06T00:31:37.572ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = BecomeUpdater
15952024-11-06T00:31:37.586ZDEBGnexus (SagaExecutor): inherited lock from 8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7 to d5941105-18c0-460d-9a0c-460a0a7e463a actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = BecomeUpdater updater_id = d5941105-18c0-460d-9a0c-460a0a7e463a
15962024-11-06T00:31:37.586ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
15972024-11-06T00:31:37.586ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
15982024-11-06T00:31:37.586ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("d5941105-18c0-460d-9a0c-460a0a7e463a")}) node_id = 1 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
15992024-11-06T00:31:37.590ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16002024-11-06T00:31:37.590ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16012024-11-06T00:31:37.593ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16022024-11-06T00:31:37.593ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16032024-11-06T00:31:37.597ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16042024-11-06T00:31:37.597ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16052024-11-06T00:31:37.600ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
16062024-11-06T00:31:37.600ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b
16072024-11-06T00:31:37.600ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = UpdateNetworkConfig
16082024-11-06T00:31:37.600ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = UpdateNetworkConfig
16092024-11-06T00:31:37.602ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = UpdateNetworkConfig
16102024-11-06T00:31:37.603ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = UpdateNetworkConfig
16112024-11-06T00:31:37.611ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
16122024-11-06T00:31:37.611ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = UpdateNetworkConfig
16132024-11-06T00:31:37.612ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = UpdateNetworkConfig
16142024-11-06T00:31:37.614ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
16152024-11-06T00:31:37.614ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
16162024-11-06T00:31:37.614ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
16172024-11-06T00:31:37.615ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
16182024-11-06T00:31:37.617ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
16192024-11-06T00:31:37.617ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
16202024-11-06T00:31:37.617ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
16212024-11-06T00:31:37.621ZDEBGnexus: notifying dendrite of updates instance_id = Some(c7df1963-d43c-46bf-b3d4-6a37670b026b (instance)) switch = switch0
16222024-11-06T00:31:37.621ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1760, tv_nsec: 968999872 } })
16232024-11-06T00:31:37.622ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
16242024-11-06T00:31:37.652ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
16252024-11-06T00:31:37.652ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16262024-11-06T00:31:37.652ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b87ac611-0eb7-413c-a440-eefc0c0b6a26", "content-length": "26", "date": "Wed, 06 Nov 2024 00:31:37 GMT"} })
16272024-11-06T00:31:37.652ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16282024-11-06T00:31:37.653ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16292024-11-06T00:31:37.682ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
16302024-11-06T00:31:37.682ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b047d70-c25a-41f9-9edd-9d43ff02fccb", "content-length": "4", "date": "Wed, 06 Nov 2024 00:31:36 GMT"} })
16312024-11-06T00:31:37.683ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16322024-11-06T00:31:37.683ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16332024-11-06T00:31:37.687ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16342024-11-06T00:31:37.687ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16352024-11-06T00:31:37.691ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
16362024-11-06T00:31:37.691ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
16372024-11-06T00:31:37.704ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-06T00:31:37.694401Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 538efd2f-b8ed-4a95-91b1-680b63627575, time_modified: Some(2024-11-06T00:31:37.694401Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 6ce0f376-6379-45db-a017-9b7dfee5a397, time_modified: Some(2024-11-06T00:31:37.694401Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
16382024-11-06T00:31:37.704ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16392024-11-06T00:31:37.704ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16402024-11-06T00:31:37.707ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16412024-11-06T00:31:37.707ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16422024-11-06T00:31:37.711ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
16432024-11-06T00:31:37.711ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = UnassignOximeterProducer
16442024-11-06T00:31:37.711ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = UnassignOximeterProducer
16452024-11-06T00:31:37.715ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e producer_id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
16462024-11-06T00:31:37.715ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = UnassignOximeterProducer
16472024-11-06T00:31:37.715ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = UnassignOximeterProducer
16482024-11-06T00:31:37.757ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:261 id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
16492024-11-06T00:31:37.759ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/c7df1963-d43c-46bf-b3d4-6a37670b026b
16502024-11-06T00:31:37.772ZDEBGnexus (SagaExecutor): client response oximeter-collector = c7df1963-d43c-46bf-b3d4-6a37670b026b result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/c7df1963-d43c-46bf-b3d4-6a37670b026b", status: 204, headers: {"x-request-id": "010fd979-1e4b-4fbd-b4f1-5e7748a3e372", "date": "Wed, 06 Nov 2024 00:31:37 GMT"} }) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
16512024-11-06T00:31:37.772ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e producer_id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
16522024-11-06T00:31:37.773ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16532024-11-06T00:31:37.773ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16542024-11-06T00:31:37.776ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16552024-11-06T00:31:37.776ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16562024-11-06T00:31:37.780ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b lock = UpdaterLock { updater_id: d5941105-18c0-460d-9a0c-460a0a7e463a, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-06T00:31:37.502363399Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
16572024-11-06T00:31:37.780ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = CommitInstanceUpdates
16582024-11-06T00:31:37.780ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = CommitInstanceUpdates
16592024-11-06T00:31:37.879ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b new_runtime = InstanceRuntimeState { time_updated: 2024-11-06T00:31:37.502363399Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
16602024-11-06T00:31:37.879ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16612024-11-06T00:31:37.879ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16622024-11-06T00:31:37.879ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
16632024-11-06T00:31:37.879ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
16642024-11-06T00:31:37.879ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16652024-11-06T00:31:37.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16662024-11-06T00:31:37.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16672024-11-06T00:31:37.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16682024-11-06T00:31:37.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16692024-11-06T00:31:37.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16702024-11-06T00:31:37.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16712024-11-06T00:31:37.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16722024-11-06T00:31:37.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16732024-11-06T00:31:37.883ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16742024-11-06T00:31:37.883ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16752024-11-06T00:31:37.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16762024-11-06T00:31:37.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16772024-11-06T00:31:37.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16782024-11-06T00:31:37.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16792024-11-06T00:31:37.885ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16802024-11-06T00:31:37.885ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("c7df1963-d43c-46bf-b3d4-6a37670b026b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("46330988-8b9f-455b-aa6c-07ae8d3bc524")}) node_id = 7 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16812024-11-06T00:31:37.889ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16822024-11-06T00:31:37.889ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16832024-11-06T00:31:37.893ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16842024-11-06T00:31:37.893ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16852024-11-06T00:31:37.896ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
16862024-11-06T00:31:37.896ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
16872024-11-06T00:31:37.899ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b propolis_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
16882024-11-06T00:31:37.899ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ReleaseSledResources
16892024-11-06T00:31:37.899ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ReleaseSledResources
16902024-11-06T00:31:37.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16912024-11-06T00:31:37.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16922024-11-06T00:31:37.920ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16932024-11-06T00:31:37.920ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16942024-11-06T00:31:37.921ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1e8b2e5-78b1-4ac3-81d1-0c61207662fe", "content-length": "372", "date": "Wed, 06 Nov 2024 00:31:37 GMT"} })
16952024-11-06T00:31:37.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16962024-11-06T00:31:37.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16972024-11-06T00:31:37.935ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {d04c5890-48aa-4e4d-951b-e3f160bd3d6f: {10.151.2.176: {d0428e7e-a355-4d59-a4c2-aa33fa6b3090}, 10.151.2.175: {d0428e7e-a355-4d59-a4c2-aa33fa6b3090}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16982024-11-06T00:31:37.935ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16992024-11-06T00:31:37.936ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e1290a87-db1a-4de2-8d8f-8f52ee112859", "date": "Wed, 06 Nov 2024 00:31:37 GMT"} })
17002024-11-06T00:31:37.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17012024-11-06T00:31:37.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17022024-11-06T00:31:37.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17032024-11-06T00:31:37.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17042024-11-06T00:31:37.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17052024-11-06T00:31:37.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17062024-11-06T00:31:37.944ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17072024-11-06T00:31:37.944ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17082024-11-06T00:31:37.944ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "42045a27-09ea-4d07-8f14-f9e6107b02dc", "date": "Wed, 06 Nov 2024 00:31:37 GMT"} })
17092024-11-06T00:31:37.946ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 67.803013ms iteration = 26 status = {}
17102024-11-06T00:31:37.992ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17112024-11-06T00:31:37.992ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
17122024-11-06T00:31:37.996ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17132024-11-06T00:31:37.996ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
17142024-11-06T00:31:38.000ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b propolis_id = 46330988-8b9f-455b-aa6c-07ae8d3bc524 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
17152024-11-06T00:31:38.000ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = MarkVmmDeleted
17162024-11-06T00:31:38.000ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = MarkVmmDeleted
17172024-11-06T00:31:38.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17182024-11-06T00:31:38.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17192024-11-06T00:31:38.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17202024-11-06T00:31:38.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17212024-11-06T00:31:38.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17222024-11-06T00:31:38.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17232024-11-06T00:31:38.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17242024-11-06T00:31:38.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17252024-11-06T00:31:38.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17262024-11-06T00:31:38.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17272024-11-06T00:31:38.041ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17282024-11-06T00:31:38.041ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
17292024-11-06T00:31:38.045ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17302024-11-06T00:31:38.045ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
17312024-11-06T00:31:38.048ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17322024-11-06T00:31:38.049ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "11ae6142-deee-4ef9-8440-f5b4b8524da2", "content-length": "691", "date": "Wed, 06 Nov 2024 00:31:37 GMT"} })
17332024-11-06T00:31:38.049ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
17342024-11-06T00:31:38.049ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
17352024-11-06T00:31:38.049ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
17362024-11-06T00:31:38.049ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17372024-11-06T00:31:38.049ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
17382024-11-06T00:31:38.049ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 170.804821ms iteration = 26 status = {}
17392024-11-06T00:31:38.052ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17402024-11-06T00:31:38.052ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
17412024-11-06T00:31:38.056ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ChainSuccessorSaga
17422024-11-06T00:31:38.056ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ChainSuccessorSaga
17432024-11-06T00:31:38.057ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ChainSuccessorSaga
17442024-11-06T00:31:38.057ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ChainSuccessorSaga
17452024-11-06T00:31:38.059ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ChainSuccessorSaga
17462024-11-06T00:31:38.059ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ChainSuccessorSaga
17472024-11-06T00:31:38.061ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ChainSuccessorSaga
17482024-11-06T00:31:38.064ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 538efd2f-b8ed-4a95-91b1-680b63627575, lookup_type: ById(538efd2f-b8ed-4a95-91b1-680b63627575) }, key: 6ce0f376-6379-45db-a017-9b7dfee5a397, lookup_type: ById(6ce0f376-6379-45db-a017-9b7dfee5a397) }, key: c7df1963-d43c-46bf-b3d4-6a37670b026b, lookup_type: ById(c7df1963-d43c-46bf-b3d4-6a37670b026b) } result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ChainSuccessorSaga
17492024-11-06T00:31:38.064ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ChainSuccessorSaga
17502024-11-06T00:31:38.064ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_node = ChainSuccessorSaga
17512024-11-06T00:31:38.070ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b karmic_state = WillReincarnate needs_reincarnation = false saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update
17522024-11-06T00:31:38.070ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17532024-11-06T00:31:38.070ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
17542024-11-06T00:31:38.076ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17552024-11-06T00:31:38.076ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
17562024-11-06T00:31:38.081ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17572024-11-06T00:31:38.081ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
17582024-11-06T00:31:38.084ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17592024-11-06T00:31:38.084ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590
17602024-11-06T00:31:38.091ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17612024-11-06T00:31:38.091ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 saga_name = instance-update saga_result = SagaResult { saga_id: 9a68fa96-8dc7-412c-a631-0a38e8596590, saga_log: SagaLog { saga_id: 9a68fa96-8dc7-412c-a631-0a38e8596590, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("d5941105-18c0-460d-9a0c-460a0a7e463a")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("d5941105-18c0-460d-9a0c-460a0a7e463a")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("c7df1963-d43c-46bf-b3d4-6a37670b026b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("46330988-8b9f-455b-aa6c-07ae8d3bc524")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("c7df1963-d43c-46bf-b3d4-6a37670b026b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("46330988-8b9f-455b-aa6c-07ae8d3bc524")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("d5941105-18c0-460d-9a0c-460a0a7e463a"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("d5941105-18c0-460d-9a0c-460a0a7e463a")}} }) }
17622024-11-06T00:31:38.092ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 9a68fa96-8dc7-412c-a631-0a38e8596590 instance_id = c7df1963-d43c-46bf-b3d4-6a37670b026b saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update
17632024-11-06T00:31:38.092ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17642024-11-06T00:31:38.092ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
17652024-11-06T00:31:38.095ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17662024-11-06T00:31:38.095ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
17672024-11-06T00:31:38.098ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17682024-11-06T00:31:38.098ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
17692024-11-06T00:31:38.102ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17702024-11-06T00:31:38.102ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2
17712024-11-06T00:31:38.133ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update sec_id = f13e9b98-ae91-4d61-ba9b-3b178cfa151a
17722024-11-06T00:31:38.133ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = f99d3314-dda1-4155-bd6f-e49b42b88dd2 saga_name = start-instance-update saga_result = SagaResult { saga_id: f99d3314-dda1-4155-bd6f-e49b42b88dd2, saga_log: SagaLog { saga_id: f99d3314-dda1-4155-bd6f-e49b42b88dd2, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("8ef664f7-c4b8-4cc0-a4e5-f006d5b29cf7")}} }) }
17732024-11-06T00:31:38.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 193b2e64-b523-42d0-a97d-4fdb3261798b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
17742024-11-06T00:31:38.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 193b2e64-b523-42d0-a97d-4fdb3261798b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
17752024-11-06T00:31:38.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 193b2e64-b523-42d0-a97d-4fdb3261798b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
17762024-11-06T00:31:38.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9ba285f3-d8df-467e-9a77-73ba63ee2e98 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17772024-11-06T00:31:38.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9ba285f3-d8df-467e-9a77-73ba63ee2e98 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17782024-11-06T00:31:38.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9ba285f3-d8df-467e-9a77-73ba63ee2e98 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17792024-11-06T00:31:39.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = a3c41878-c516-4e6e-ac74-b76d17853780 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
17802024-11-06T00:31:39.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = a3c41878-c516-4e6e-ac74-b76d17853780 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
17812024-11-06T00:31:39.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = a3c41878-c516-4e6e-ac74-b76d17853780 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
17822024-11-06T00:31:39.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f9224030-ab98-4088-bc13-17e1fd737bc1 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17832024-11-06T00:31:39.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f9224030-ab98-4088-bc13-17e1fd737bc1 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17842024-11-06T00:31:39.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f9224030-ab98-4088-bc13-17e1fd737bc1 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17852024-11-06T00:31:40.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fb24bb63-3051-4ecb-a565-8f81314e56a8 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17862024-11-06T00:31:40.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fb24bb63-3051-4ecb-a565-8f81314e56a8 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17872024-11-06T00:31:40.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fb24bb63-3051-4ecb-a565-8f81314e56a8 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17882024-11-06T00:31:41.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 63cbfd0b-b811-45bf-a38e-7287f403980f roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17892024-11-06T00:31:41.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 63cbfd0b-b811-45bf-a38e-7287f403980f resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17902024-11-06T00:31:41.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 63cbfd0b-b811-45bf-a38e-7287f403980f response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17912024-11-06T00:31:42.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 25b02330-ff58-4082-8dd7-f8b84a72b1bb roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17922024-11-06T00:31:42.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 25b02330-ff58-4082-8dd7-f8b84a72b1bb resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17932024-11-06T00:31:42.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 25b02330-ff58-4082-8dd7-f8b84a72b1bb response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17942024-11-06T00:31:43.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9a27ad9b-a5a1-4b5c-83c5-4490c8627bf9 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17952024-11-06T00:31:43.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9a27ad9b-a5a1-4b5c-83c5-4490c8627bf9 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17962024-11-06T00:31:43.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9a27ad9b-a5a1-4b5c-83c5-4490c8627bf9 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17972024-11-06T00:31:44.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0207020e-85ae-478c-93de-5d3db5205c4b roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17982024-11-06T00:31:44.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0207020e-85ae-478c-93de-5d3db5205c4b resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
17992024-11-06T00:31:44.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0207020e-85ae-478c-93de-5d3db5205c4b response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18002024-11-06T00:31:45.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
18012024-11-06T00:31:45.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18022024-11-06T00:31:45.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18032024-11-06T00:31:45.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
18042024-11-06T00:31:45.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18052024-11-06T00:31:45.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18062024-11-06T00:31:45.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18072024-11-06T00:31:45.497ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18082024-11-06T00:31:45.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18092024-11-06T00:31:45.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18102024-11-06T00:31:45.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18112024-11-06T00:31:45.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18122024-11-06T00:31:45.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18132024-11-06T00:31:45.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18142024-11-06T00:31:45.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ad2561ef-a9cf-42fe-92f3-d451b91ae8be roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18152024-11-06T00:31:45.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ad2561ef-a9cf-42fe-92f3-d451b91ae8be resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18162024-11-06T00:31:45.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18172024-11-06T00:31:45.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ad2561ef-a9cf-42fe-92f3-d451b91ae8be response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18182024-11-06T00:31:45.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
18192024-11-06T00:31:45.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18202024-11-06T00:31:45.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18212024-11-06T00:31:45.517ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
18222024-11-06T00:31:45.517ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.646982ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
18232024-11-06T00:31:45.525ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.367371ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18242024-11-06T00:31:46.468ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 628 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = df836fdb-dbb1-45aa-99a1-26e87844d561 response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
18252024-11-06T00:31:46.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = faff18f8-832a-4f72-a1b3-923e51ea9198 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18262024-11-06T00:31:46.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = faff18f8-832a-4f72-a1b3-923e51ea9198 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18272024-11-06T00:31:46.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = faff18f8-832a-4f72-a1b3-923e51ea9198 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18282024-11-06T00:31:47.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 2a3b2747-668b-4cdf-a17f-45ff89ea31d7 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18292024-11-06T00:31:47.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 2a3b2747-668b-4cdf-a17f-45ff89ea31d7 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18302024-11-06T00:31:47.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 2a3b2747-668b-4cdf-a17f-45ff89ea31d7 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18312024-11-06T00:31:48.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 871ed21b-a8a4-4e87-a20f-74a91070a832 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18322024-11-06T00:31:48.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 871ed21b-a8a4-4e87-a20f-74a91070a832 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18332024-11-06T00:31:48.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 871ed21b-a8a4-4e87-a20f-74a91070a832 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18342024-11-06T00:31:49.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a28811da-af59-4d5f-9b1a-2c030471b5cd roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18352024-11-06T00:31:49.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a28811da-af59-4d5f-9b1a-2c030471b5cd resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18362024-11-06T00:31:49.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a28811da-af59-4d5f-9b1a-2c030471b5cd response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18372024-11-06T00:31:50.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a852df97-14ef-42ec-8874-10ff4923b25d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18382024-11-06T00:31:50.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a852df97-14ef-42ec-8874-10ff4923b25d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18392024-11-06T00:31:50.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a852df97-14ef-42ec-8874-10ff4923b25d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18402024-11-06T00:31:51.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 82f006ae-fa81-4f56-9064-c25dc9ad90db roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18412024-11-06T00:31:51.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 82f006ae-fa81-4f56-9064-c25dc9ad90db resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18422024-11-06T00:31:51.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 82f006ae-fa81-4f56-9064-c25dc9ad90db response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18432024-11-06T00:31:52.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3e2f796a-fea1-4760-80c0-f63020661778 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18442024-11-06T00:31:52.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3e2f796a-fea1-4760-80c0-f63020661778 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18452024-11-06T00:31:52.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3e2f796a-fea1-4760-80c0-f63020661778 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18462024-11-06T00:31:53.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8cc80c34-3195-40e8-8479-bfc7e5c012a4 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18472024-11-06T00:31:53.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8cc80c34-3195-40e8-8479-bfc7e5c012a4 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18482024-11-06T00:31:53.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8cc80c34-3195-40e8-8479-bfc7e5c012a4 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18492024-11-06T00:31:54.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 61b82dc7-bbf6-499a-8d17-b24fbc9dce96 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18502024-11-06T00:31:54.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 61b82dc7-bbf6-499a-8d17-b24fbc9dce96 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18512024-11-06T00:31:54.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 61b82dc7-bbf6-499a-8d17-b24fbc9dce96 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
18522024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
18532024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
18542024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18552024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
18562024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18572024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
18582024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18592024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
18602024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18612024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
18622024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
18632024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
18642024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18652024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18662024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18672024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
18682024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18692024-11-06T00:31:55.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18702024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18712024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18722024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18732024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18742024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18752024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18762024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18772024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
18782024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
18792024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
18802024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18812024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
18822024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.76\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18832024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
18842024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
18852024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.03\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18862024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18872024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.35\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
18882024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
18892024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.82\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
18902024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
18912024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18922024-11-06T00:31:55.495ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18932024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18942024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18952024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18962024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18972024-11-06T00:31:55.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18982024-11-06T00:31:55.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18992024-11-06T00:31:55.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19002024-11-06T00:31:55.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19012024-11-06T00:31:55.498ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.497123ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19022024-11-06T00:31:55.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19032024-11-06T00:31:55.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19042024-11-06T00:31:55.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19052024-11-06T00:31:55.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19062024-11-06T00:31:55.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19072024-11-06T00:31:55.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19082024-11-06T00:31:55.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19092024-11-06T00:31:55.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19102024-11-06T00:31:55.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19112024-11-06T00:31:55.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19122024-11-06T00:31:55.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19132024-11-06T00:31:55.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19142024-11-06T00:31:55.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19152024-11-06T00:31:55.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19162024-11-06T00:31:55.502ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1778, tv_nsec: 850122795 } })
19172024-11-06T00:31:55.503ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1778, tv_nsec: 850223028 } })
19182024-11-06T00:31:55.503ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
19192024-11-06T00:31:55.503ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
19202024-11-06T00:31:55.503ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19212024-11-06T00:31:55.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19222024-11-06T00:31:55.504ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19232024-11-06T00:31:55.504ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19242024-11-06T00:31:55.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19252024-11-06T00:31:55.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19262024-11-06T00:31:55.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19272024-11-06T00:31:55.505ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1778, tv_nsec: 852954299 } })
19282024-11-06T00:31:55.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19292024-11-06T00:31:55.506ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
19302024-11-06T00:31:55.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19312024-11-06T00:31:55.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19322024-11-06T00:31:55.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19332024-11-06T00:31:55.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19342024-11-06T00:31:55.507ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19352024-11-06T00:31:55.507ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19362024-11-06T00:31:55.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19372024-11-06T00:31:55.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19382024-11-06T00:31:55.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19392024-11-06T00:31:55.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
19402024-11-06T00:31:55.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19412024-11-06T00:31:55.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19422024-11-06T00:31:55.531ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
19432024-11-06T00:31:55.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.179044ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
19442024-11-06T00:31:55.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19452024-11-06T00:31:55.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19462024-11-06T00:31:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19472024-11-06T00:31:55.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19482024-11-06T00:31:55.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19492024-11-06T00:31:55.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19502024-11-06T00:31:55.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19512024-11-06T00:31:55.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19522024-11-06T00:31:55.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19532024-11-06T00:31:55.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19542024-11-06T00:31:55.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19552024-11-06T00:31:55.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
19562024-11-06T00:31:55.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19572024-11-06T00:31:55.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19582024-11-06T00:31:55.544ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19592024-11-06T00:31:55.544ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.731407ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
19602024-11-06T00:31:55.544ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 50.123778ms iteration = 26 status = 0
19612024-11-06T00:31:55.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19622024-11-06T00:31:55.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19632024-11-06T00:31:55.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19642024-11-06T00:31:55.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19652024-11-06T00:31:55.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.538669ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19662024-11-06T00:31:55.552ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19672024-11-06T00:31:55.552ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19682024-11-06T00:31:55.552ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 57.033564ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19692024-11-06T00:31:55.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702024-11-06T00:31:55.554ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19712024-11-06T00:31:55.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19722024-11-06T00:31:55.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19732024-11-06T00:31:55.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19742024-11-06T00:31:55.558ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
19752024-11-06T00:31:55.558ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19762024-11-06T00:31:55.559ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "218df5be-ef37-454a-bfd9-619dd302bc7f", "content-length": "26", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
19772024-11-06T00:31:55.559ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19782024-11-06T00:31:55.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19792024-11-06T00:31:55.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19802024-11-06T00:31:55.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19812024-11-06T00:31:55.560ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19822024-11-06T00:31:55.565ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
19832024-11-06T00:31:55.565ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19842024-11-06T00:31:55.565ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba6f495c-19aa-479f-8751-2154644f2e49", "content-length": "26", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
19852024-11-06T00:31:55.565ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19862024-11-06T00:31:55.567ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
19872024-11-06T00:31:55.567ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
19882024-11-06T00:31:55.567ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19892024-11-06T00:31:55.567ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0843f547-b3aa-4d17-8940-112edcd15a6c", "content-length": "26", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
19902024-11-06T00:31:55.567ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19912024-11-06T00:31:55.569ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19922024-11-06T00:31:55.574ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.81095ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19932024-11-06T00:31:55.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19942024-11-06T00:31:55.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19952024-11-06T00:31:55.652ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.514697ms iteration = 29 status = {"physical_disks_added":0}
19962024-11-06T00:31:55.669ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 175.310505ms iteration = 26 status = {}
19972024-11-06T00:31:55.689ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19982024-11-06T00:31:55.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19992024-11-06T00:31:55.711ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20002024-11-06T00:31:55.711ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "01bb4fb6-9522-452e-888c-cf3f3fd86ae7", "content-length": "2", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
20012024-11-06T00:31:55.713ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20022024-11-06T00:31:55.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20032024-11-06T00:31:55.732ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20042024-11-06T00:31:55.732ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20052024-11-06T00:31:55.732ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecf888f8-06f4-45f1-bfd5-7a562a8b1ed1", "content-length": "372", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
20062024-11-06T00:31:55.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20072024-11-06T00:31:55.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20082024-11-06T00:31:55.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20092024-11-06T00:31:55.734ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 239.930613ms iteration = 26 status = null
20102024-11-06T00:31:55.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20112024-11-06T00:31:55.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20122024-11-06T00:31:55.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20132024-11-06T00:31:55.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20142024-11-06T00:31:55.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20152024-11-06T00:31:55.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20162024-11-06T00:31:55.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20172024-11-06T00:31:55.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 91ba45fa-c632-46b0-9cbe-8ab1045132dd roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20182024-11-06T00:31:55.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 91ba45fa-c632-46b0-9cbe-8ab1045132dd resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20192024-11-06T00:31:55.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 91ba45fa-c632-46b0-9cbe-8ab1045132dd response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20202024-11-06T00:31:55.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20212024-11-06T00:31:55.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20222024-11-06T00:31:55.761ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
20232024-11-06T00:31:55.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20242024-11-06T00:31:55.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20252024-11-06T00:31:55.771ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20262024-11-06T00:31:55.771ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a017a5de-43a6-484f-87d4-368d07fc9257", "content-length": "121", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
20272024-11-06T00:31:55.771ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
20282024-11-06T00:31:55.771ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
20292024-11-06T00:31:55.771ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20302024-11-06T00:31:55.771ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20312024-11-06T00:31:55.771ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20322024-11-06T00:31:55.771ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20332024-11-06T00:31:55.771ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20342024-11-06T00:31:55.771ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20352024-11-06T00:31:55.772ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20362024-11-06T00:31:55.772ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20372024-11-06T00:31:55.772ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
20382024-11-06T00:31:55.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20392024-11-06T00:31:55.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20402024-11-06T00:31:55.775ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20412024-11-06T00:31:55.775ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "372927c0-bd94-412b-853e-7f244826cda0", "content-length": "2", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
20422024-11-06T00:31:55.775ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20432024-11-06T00:31:55.775ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a070029a-93e7-4d95-8234-8ad796cc61f5", "content-length": "52", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
20442024-11-06T00:31:55.775ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
20452024-11-06T00:31:55.775ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20462024-11-06T00:31:55.779ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20472024-11-06T00:31:55.779ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20482024-11-06T00:31:55.847ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20492024-11-06T00:31:55.909ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "789ae52a-372f-4746-aeb7-ce75ebd970b0", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
20502024-11-06T00:31:55.909ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
20512024-11-06T00:31:55.909ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20522024-11-06T00:31:55.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f09d3dd2-0813-48ae-8904-43070f877624", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
20532024-11-06T00:31:55.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20542024-11-06T00:31:55.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20552024-11-06T00:31:55.910ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b194a6b7-8c04-4bc4-b81e-f4c3ed17d60e", "content-length": "669", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
20562024-11-06T00:31:55.910ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a463d49a-fa82-4a14-ae8f-8dd7d10e120a", "content-length": "691", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
20572024-11-06T00:31:55.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20582024-11-06T00:31:55.910ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20592024-11-06T00:31:55.910ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20602024-11-06T00:31:55.910ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20612024-11-06T00:31:55.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20622024-11-06T00:31:55.911ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 417.374881ms iteration = 27 status = {}
20632024-11-06T00:31:55.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20642024-11-06T00:31:55.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20652024-11-06T00:31:55.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20662024-11-06T00:31:55.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20672024-11-06T00:31:55.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20682024-11-06T00:31:55.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20692024-11-06T00:31:55.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20702024-11-06T00:31:55.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20712024-11-06T00:31:55.920ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20722024-11-06T00:31:55.920ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20732024-11-06T00:31:55.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20742024-11-06T00:31:55.920ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a10eb730-54a9-4281-9a93-7d1ba72dc30f", "date": "Wed, 06 Nov 2024 00:31:55 GMT"} })
20752024-11-06T00:31:55.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20762024-11-06T00:31:55.922ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 426.633697ms iteration = 27 status = {}
20772024-11-06T00:31:55.927ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 433.410987ms iteration = 26 status = {}
20782024-11-06T00:31:56.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 18f0a6cd-1dcd-423c-8082-8f9abedf5bfc roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20792024-11-06T00:31:56.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 18f0a6cd-1dcd-423c-8082-8f9abedf5bfc resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20802024-11-06T00:31:56.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 18f0a6cd-1dcd-423c-8082-8f9abedf5bfc response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20812024-11-06T00:31:57.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 90ee42c7-10fc-4333-bf9c-fb3016788e87 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20822024-11-06T00:31:57.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 90ee42c7-10fc-4333-bf9c-fb3016788e87 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20832024-11-06T00:31:57.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 90ee42c7-10fc-4333-bf9c-fb3016788e87 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20842024-11-06T00:31:58.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = bf92b17d-bb6b-4445-90fe-9a475c9e8bb1 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20852024-11-06T00:31:58.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = bf92b17d-bb6b-4445-90fe-9a475c9e8bb1 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20862024-11-06T00:31:58.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = bf92b17d-bb6b-4445-90fe-9a475c9e8bb1 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20872024-11-06T00:31:59.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 059381f4-3708-4ce5-af99-5bacb9ee8dc8 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20882024-11-06T00:31:59.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 059381f4-3708-4ce5-af99-5bacb9ee8dc8 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20892024-11-06T00:31:59.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 059381f4-3708-4ce5-af99-5bacb9ee8dc8 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20902024-11-06T00:32:00.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 29b8dfc3-48e9-4fe3-9082-96a0f09ac298 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20912024-11-06T00:32:00.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 29b8dfc3-48e9-4fe3-9082-96a0f09ac298 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20922024-11-06T00:32:00.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 29b8dfc3-48e9-4fe3-9082-96a0f09ac298 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20932024-11-06T00:32:01.470ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1037 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = fb00ed12-5f94-4eee-acba-20002a8d398b response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
20942024-11-06T00:32:01.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8929ad69-474c-4693-b20d-88007cb11790 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20952024-11-06T00:32:01.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8929ad69-474c-4693-b20d-88007cb11790 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20962024-11-06T00:32:01.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8929ad69-474c-4693-b20d-88007cb11790 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20972024-11-06T00:32:02.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 1653ab1d-a7df-4726-88ea-dcd5cb6a4d39 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20982024-11-06T00:32:02.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 1653ab1d-a7df-4726-88ea-dcd5cb6a4d39 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
20992024-11-06T00:32:02.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 1653ab1d-a7df-4726-88ea-dcd5cb6a4d39 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21002024-11-06T00:32:03.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9ebe88c3-43f0-4f91-975d-744e11d05d31 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21012024-11-06T00:32:03.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9ebe88c3-43f0-4f91-975d-744e11d05d31 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21022024-11-06T00:32:03.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9ebe88c3-43f0-4f91-975d-744e11d05d31 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21032024-11-06T00:32:04.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ec5599f4-4202-4714-9ad6-29faa560c76f roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21042024-11-06T00:32:04.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ec5599f4-4202-4714-9ad6-29faa560c76f resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21052024-11-06T00:32:04.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ec5599f4-4202-4714-9ad6-29faa560c76f response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21062024-11-06T00:32:05.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
21072024-11-06T00:32:05.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21082024-11-06T00:32:05.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21092024-11-06T00:32:05.495ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
21102024-11-06T00:32:05.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21112024-11-06T00:32:05.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21122024-11-06T00:32:05.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21132024-11-06T00:32:05.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21142024-11-06T00:32:05.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21152024-11-06T00:32:05.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21162024-11-06T00:32:05.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21172024-11-06T00:32:05.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21182024-11-06T00:32:05.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21192024-11-06T00:32:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21202024-11-06T00:32:05.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21212024-11-06T00:32:05.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.142193ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21222024-11-06T00:32:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
21232024-11-06T00:32:05.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21242024-11-06T00:32:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21252024-11-06T00:32:05.545ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
21262024-11-06T00:32:05.545ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.482119ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
21272024-11-06T00:32:05.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 501f43ae-2936-49b5-a659-e9b31c71b9af roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21282024-11-06T00:32:05.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 501f43ae-2936-49b5-a659-e9b31c71b9af resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21292024-11-06T00:32:05.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 501f43ae-2936-49b5-a659-e9b31c71b9af response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21302024-11-06T00:32:07.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 570aad9e-f505-40ef-8a91-9c28abb4b902 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21312024-11-06T00:32:07.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 570aad9e-f505-40ef-8a91-9c28abb4b902 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21322024-11-06T00:32:07.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 570aad9e-f505-40ef-8a91-9c28abb4b902 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21332024-11-06T00:32:08.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0c095e26-220b-41a2-b346-da4b1191e378 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21342024-11-06T00:32:08.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0c095e26-220b-41a2-b346-da4b1191e378 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21352024-11-06T00:32:08.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 0c095e26-220b-41a2-b346-da4b1191e378 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21362024-11-06T00:32:09.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6ceed120-54ab-491e-a511-0f03de2a8b81 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21372024-11-06T00:32:09.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6ceed120-54ab-491e-a511-0f03de2a8b81 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21382024-11-06T00:32:09.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6ceed120-54ab-491e-a511-0f03de2a8b81 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21392024-11-06T00:32:09.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = fa81e3c6-4af2-45a1-a924-906ab85c1db0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
21402024-11-06T00:32:09.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = fa81e3c6-4af2-45a1-a924-906ab85c1db0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
21412024-11-06T00:32:09.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = fa81e3c6-4af2-45a1-a924-906ab85c1db0 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
21422024-11-06T00:32:10.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5789b3cd-2585-43c7-adf0-ab22229e8281 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21432024-11-06T00:32:10.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5789b3cd-2585-43c7-adf0-ab22229e8281 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21442024-11-06T00:32:10.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5789b3cd-2585-43c7-adf0-ab22229e8281 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21452024-11-06T00:32:11.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7fc52911-9574-4ca6-a0c0-ae9aeb47df15 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21462024-11-06T00:32:11.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7fc52911-9574-4ca6-a0c0-ae9aeb47df15 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21472024-11-06T00:32:11.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7fc52911-9574-4ca6-a0c0-ae9aeb47df15 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21482024-11-06T00:32:12.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8a384601-73cd-4f3d-804f-3f0d33c203e6 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21492024-11-06T00:32:12.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8a384601-73cd-4f3d-804f-3f0d33c203e6 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21502024-11-06T00:32:12.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8a384601-73cd-4f3d-804f-3f0d33c203e6 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21512024-11-06T00:32:13.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 276f8fcc-b083-4197-abce-18c24a863ea3 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21522024-11-06T00:32:13.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 276f8fcc-b083-4197-abce-18c24a863ea3 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21532024-11-06T00:32:13.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 276f8fcc-b083-4197-abce-18c24a863ea3 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21542024-11-06T00:32:14.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f7d2ce1e-6695-44fe-8736-2f8a0c777748 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21552024-11-06T00:32:14.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f7d2ce1e-6695-44fe-8736-2f8a0c777748 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21562024-11-06T00:32:14.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f7d2ce1e-6695-44fe-8736-2f8a0c777748 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21572024-11-06T00:32:15.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 394eb025-274c-4364-aa73-e3026e58aec4 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21582024-11-06T00:32:15.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 394eb025-274c-4364-aa73-e3026e58aec4 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21592024-11-06T00:32:15.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 394eb025-274c-4364-aa73-e3026e58aec4 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21602024-11-06T00:32:15.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
21612024-11-06T00:32:15.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21622024-11-06T00:32:15.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21632024-11-06T00:32:15.494ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
21642024-11-06T00:32:15.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21652024-11-06T00:32:15.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21662024-11-06T00:32:15.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21672024-11-06T00:32:15.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21682024-11-06T00:32:15.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21692024-11-06T00:32:15.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21702024-11-06T00:32:15.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21712024-11-06T00:32:15.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21722024-11-06T00:32:15.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21732024-11-06T00:32:15.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
21742024-11-06T00:32:15.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21752024-11-06T00:32:15.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21762024-11-06T00:32:15.516ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
21772024-11-06T00:32:15.516ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.434696ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
21782024-11-06T00:32:15.523ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21792024-11-06T00:32:15.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21802024-11-06T00:32:15.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.044374ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21812024-11-06T00:32:16.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 11af1fcb-0dab-4b0c-9367-95e30b22b408 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21822024-11-06T00:32:16.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 11af1fcb-0dab-4b0c-9367-95e30b22b408 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21832024-11-06T00:32:16.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 11af1fcb-0dab-4b0c-9367-95e30b22b408 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21842024-11-06T00:32:16.471ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1081 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = 1f094079-3a78-4c7b-b854-559f0fe0683f response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
21852024-11-06T00:32:17.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4252c9df-931c-42b6-bf2f-f126d1a83fbc roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21862024-11-06T00:32:17.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4252c9df-931c-42b6-bf2f-f126d1a83fbc resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21872024-11-06T00:32:17.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4252c9df-931c-42b6-bf2f-f126d1a83fbc response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21882024-11-06T00:32:18.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f1e649c4-639c-40f3-a992-343c9ff3a230 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21892024-11-06T00:32:18.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f1e649c4-639c-40f3-a992-343c9ff3a230 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21902024-11-06T00:32:18.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = f1e649c4-639c-40f3-a992-343c9ff3a230 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21912024-11-06T00:32:19.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d23f9912-0f8d-451b-979a-7f402cf4bb98 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21922024-11-06T00:32:19.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d23f9912-0f8d-451b-979a-7f402cf4bb98 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21932024-11-06T00:32:19.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d23f9912-0f8d-451b-979a-7f402cf4bb98 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21942024-11-06T00:32:20.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3622f51f-ac7b-4c41-ba3e-0f49f34ad4a3 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21952024-11-06T00:32:20.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3622f51f-ac7b-4c41-ba3e-0f49f34ad4a3 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21962024-11-06T00:32:20.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3622f51f-ac7b-4c41-ba3e-0f49f34ad4a3 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21972024-11-06T00:32:21.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a70280ab-4a3d-4764-90f1-1cc805b640ea roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21982024-11-06T00:32:21.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a70280ab-4a3d-4764-90f1-1cc805b640ea resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
21992024-11-06T00:32:21.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = a70280ab-4a3d-4764-90f1-1cc805b640ea response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22002024-11-06T00:32:22.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5ac027ef-d6d8-4d1e-b56b-f0cbbb5fb7ee roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22012024-11-06T00:32:22.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5ac027ef-d6d8-4d1e-b56b-f0cbbb5fb7ee resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22022024-11-06T00:32:22.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 5ac027ef-d6d8-4d1e-b56b-f0cbbb5fb7ee response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22032024-11-06T00:32:23.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d0c8bd3a-951c-444c-80ec-799c9a664f41 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22042024-11-06T00:32:23.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d0c8bd3a-951c-444c-80ec-799c9a664f41 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22052024-11-06T00:32:23.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = d0c8bd3a-951c-444c-80ec-799c9a664f41 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22062024-11-06T00:32:24.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ea6e3185-a468-4958-886f-d8df089a26e5 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22072024-11-06T00:32:24.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ea6e3185-a468-4958-886f-d8df089a26e5 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22082024-11-06T00:32:24.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ea6e3185-a468-4958-886f-d8df089a26e5 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22092024-11-06T00:32:25.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fd51c3bd-eaa8-47f7-ba8f-ba02a757538c roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22102024-11-06T00:32:25.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fd51c3bd-eaa8-47f7-ba8f-ba02a757538c resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22112024-11-06T00:32:25.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fd51c3bd-eaa8-47f7-ba8f-ba02a757538c response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
22122024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
22132024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
22142024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22152024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22162024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22172024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
22182024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
22192024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22202024-11-06T00:32:25.494ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-06 00:22:25.494382059 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22212024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
22222024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22232024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22242024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22252024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
22262024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22272024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
22282024-11-06T00:32:25.494ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846
22292024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.321\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846"}
22302024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
22312024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
22322024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
22332024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
22342024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
22352024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22362024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
22372024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
22382024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22392024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
22402024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22412024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
22422024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
22432024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
22442024-11-06T00:32:25.494ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22452024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22462024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22472024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
22482024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22492024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22502024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
22512024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.97\u{b5}s iteration = 27 status = {"errors":[],"records_set_to_done":[]}
22522024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
22532024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
22542024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22552024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.871\u{b5}s iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22562024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
22572024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
22582024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22592024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22602024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
22612024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22622024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
22632024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.27\u{b5}s iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22642024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
22652024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
22662024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22672024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22682024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22692024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
22702024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
22712024-11-06T00:32:25.494ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22722024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.931\u{b5}s iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
22732024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22742024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22752024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22762024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22772024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22782024-11-06T00:32:25.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22792024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22802024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22812024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22822024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22832024-11-06T00:32:25.495ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("309c9aef-da72-4f08-9f70-c20d80316472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9bf7f7e3-0a6c-48b6-84be-c4bb8425f761.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1808, tv_nsec: 842615542 } })
22842024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22852024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22862024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22872024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22882024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22892024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22902024-11-06T00:32:25.495ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51df9631-cef5-49ae-8cfd-f0c05bdac388.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7102227a-61f8-4dda-a9a0-f6678fae71c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ad2fb963-23a1-4187-b186-e731e9dae98d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1808, tv_nsec: 842713115 } })
22912024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22922024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22932024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22942024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22952024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22962024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22972024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.036671ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22982024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
22992024-11-06T00:32:25.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.250357ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
23002024-11-06T00:32:25.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23012024-11-06T00:32:25.497ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23022024-11-06T00:32:25.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23032024-11-06T00:32:25.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23042024-11-06T00:32:25.499ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.486404ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23052024-11-06T00:32:25.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23062024-11-06T00:32:25.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23072024-11-06T00:32:25.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23082024-11-06T00:32:25.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23092024-11-06T00:32:25.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23102024-11-06T00:32:25.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23112024-11-06T00:32:25.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23122024-11-06T00:32:25.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23132024-11-06T00:32:25.502ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-06 00:22:25.494382059 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23142024-11-06T00:32:25.502ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.106931ms iteration = 14 status = {"expiration":"2024-11-06T00:22:25.494382059Z","pruned":[]}
23152024-11-06T00:32:25.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23162024-11-06T00:32:25.503ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1808, tv_nsec: 851179996 } })
23172024-11-06T00:32:25.503ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
23182024-11-06T00:32:25.505ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1808, tv_nsec: 852564807 } })
23192024-11-06T00:32:25.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23202024-11-06T00:32:25.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23212024-11-06T00:32:25.505ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
23222024-11-06T00:32:25.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23232024-11-06T00:32:25.507ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.577503ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
23242024-11-06T00:32:25.512ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7c647f25-eb29-494d-840d-11658133af45.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1808, tv_nsec: 859752911 } })
23252024-11-06T00:32:25.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23262024-11-06T00:32:25.512ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
23272024-11-06T00:32:25.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23282024-11-06T00:32:25.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23292024-11-06T00:32:25.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23302024-11-06T00:32:25.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23312024-11-06T00:32:25.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23322024-11-06T00:32:25.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23332024-11-06T00:32:25.542ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23342024-11-06T00:32:25.542ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23352024-11-06T00:32:25.542ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 47.738887ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23362024-11-06T00:32:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23372024-11-06T00:32:25.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23382024-11-06T00:32:25.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23392024-11-06T00:32:25.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23402024-11-06T00:32:25.544ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23412024-11-06T00:32:25.544ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23422024-11-06T00:32:25.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23432024-11-06T00:32:25.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23442024-11-06T00:32:25.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23452024-11-06T00:32:25.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23462024-11-06T00:32:25.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
23472024-11-06T00:32:25.547ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23482024-11-06T00:32:25.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23492024-11-06T00:32:25.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23502024-11-06T00:32:25.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23512024-11-06T00:32:25.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23522024-11-06T00:32:25.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23532024-11-06T00:32:25.550ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23542024-11-06T00:32:25.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23552024-11-06T00:32:25.552ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23562024-11-06T00:32:25.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23572024-11-06T00:32:25.552ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23582024-11-06T00:32:25.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23592024-11-06T00:32:25.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23602024-11-06T00:32:25.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23612024-11-06T00:32:25.554ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23622024-11-06T00:32:25.554ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23632024-11-06T00:32:25.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23642024-11-06T00:32:25.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23652024-11-06T00:32:25.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23662024-11-06T00:32:25.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23672024-11-06T00:32:25.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23682024-11-06T00:32:25.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23692024-11-06T00:32:25.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23702024-11-06T00:32:25.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23712024-11-06T00:32:25.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23722024-11-06T00:32:25.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23732024-11-06T00:32:25.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23742024-11-06T00:32:25.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23752024-11-06T00:32:25.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23762024-11-06T00:32:25.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23772024-11-06T00:32:25.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23782024-11-06T00:32:25.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
23792024-11-06T00:32:25.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23802024-11-06T00:32:25.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23812024-11-06T00:32:25.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23822024-11-06T00:32:25.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23832024-11-06T00:32:25.573ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23842024-11-06T00:32:25.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23852024-11-06T00:32:25.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23862024-11-06T00:32:25.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23872024-11-06T00:32:25.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23882024-11-06T00:32:25.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23892024-11-06T00:32:25.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.573979ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23902024-11-06T00:32:25.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23912024-11-06T00:32:25.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23922024-11-06T00:32:25.589ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23932024-11-06T00:32:25.589ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23942024-11-06T00:32:25.589ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23952024-11-06T00:32:25.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23962024-11-06T00:32:25.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23972024-11-06T00:32:25.591ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
23982024-11-06T00:32:25.591ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.770553ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
23992024-11-06T00:32:25.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24002024-11-06T00:32:25.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24012024-11-06T00:32:25.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24022024-11-06T00:32:25.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24032024-11-06T00:32:25.595ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24042024-11-06T00:32:25.595ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24052024-11-06T00:32:25.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24062024-11-06T00:32:25.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24072024-11-06T00:32:25.595ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
24082024-11-06T00:32:25.595ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
24092024-11-06T00:32:25.595ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 101.099731ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
24102024-11-06T00:32:25.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24112024-11-06T00:32:25.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7c647f25-eb29-494d-840d-11658133af45, lookup_type: ById(7c647f25-eb29-494d-840d-11658133af45) } result = Ok(())
24122024-11-06T00:32:25.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24132024-11-06T00:32:25.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24142024-11-06T00:32:25.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 106.232993ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24152024-11-06T00:32:25.601ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.580994ms iteration = 27 status = 0
24162024-11-06T00:32:25.601ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24172024-11-06T00:32:25.601ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24182024-11-06T00:32:25.601ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24192024-11-06T00:32:25.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24202024-11-06T00:32:25.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24212024-11-06T00:32:25.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24222024-11-06T00:32:25.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24232024-11-06T00:32:25.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24242024-11-06T00:32:25.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24252024-11-06T00:32:25.606ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24262024-11-06T00:32:25.606ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.366836ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24272024-11-06T00:32:25.611ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24282024-11-06T00:32:25.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24292024-11-06T00:32:25.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24302024-11-06T00:32:25.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24312024-11-06T00:32:25.614ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24322024-11-06T00:32:25.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24332024-11-06T00:32:25.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24342024-11-06T00:32:25.623ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24352024-11-06T00:32:25.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24362024-11-06T00:32:25.623ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
24372024-11-06T00:32:25.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24382024-11-06T00:32:25.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24392024-11-06T00:32:25.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24402024-11-06T00:32:25.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24412024-11-06T00:32:25.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24422024-11-06T00:32:25.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24432024-11-06T00:32:25.629ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e566332b-6115-4b51-a3f7-2d789db7f0b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
24442024-11-06T00:32:25.630ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24452024-11-06T00:32:25.630ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-06 00:19:33.391850 UTC dns_group = external generation = 2
24462024-11-06T00:32:25.630ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 135.631457ms iteration = 14 status = {"generation":2}
24472024-11-06T00:32:25.630ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24482024-11-06T00:32:25.630ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24492024-11-06T00:32:25.630ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.121551ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24502024-11-06T00:32:25.645ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24512024-11-06T00:32:25.645ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24522024-11-06T00:32:25.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24532024-11-06T00:32:25.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24542024-11-06T00:32:25.652ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
24552024-11-06T00:32:25.652ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24562024-11-06T00:32:25.653ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24572024-11-06T00:32:25.653ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec6f3deb-aa18-4333-b9ce-bbbf7619a6d9", "content-length": "26", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
24582024-11-06T00:32:25.653ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24592024-11-06T00:32:25.655ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24602024-11-06T00:32:25.658ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-06T00:19:22.736570Z, time_modified: 2024-11-06T00:19:22.736570Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 538efd2f-b8ed-4a95-91b1-680b63627575, db_silo: Silo { identity: SiloIdentity { id: 538efd2f-b8ed-4a95-91b1-680b63627575, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-06T00:19:33.340114Z, time_modified: 2024-11-06T00:19:33.340114Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9" }] }) }
24612024-11-06T00:32:25.658ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 164.183894ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]}},"default_endpoint":{"silo_id":"538efd2f-b8ed-4a95-91b1-680b63627575","tls_certs":["a1fe0af34bdc26f4969481fb712f7f75d3ee00bb10c1b2afec1db21a3adddac9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
24622024-11-06T00:32:25.676ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
24632024-11-06T00:32:25.676ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 181.933481ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
24642024-11-06T00:32:25.683ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
24652024-11-06T00:32:25.684ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa zone_address = fd00:1122:3344:101::2
24662024-11-06T00:32:25.684ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24672024-11-06T00:32:25.685ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "60895a6d-aa11-4409-8928-4061964eaee0", "content-length": "26", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
24682024-11-06T00:32:25.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24692024-11-06T00:32:25.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
24702024-11-06T00:32:25.687ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 193.415692ms iteration = 30 status = {"physical_disks_added":0}
24712024-11-06T00:32:25.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24722024-11-06T00:32:25.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24732024-11-06T00:32:25.704ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
24742024-11-06T00:32:25.704ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24752024-11-06T00:32:25.704ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc8b0ff1-d010-4e5d-8eba-42978fbfb357", "content-length": "26", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
24762024-11-06T00:32:25.704ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24772024-11-06T00:32:25.706ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24782024-11-06T00:32:25.802ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24792024-11-06T00:32:25.802ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cf7a07aa-dc1f-4dd7-a108-63aca0ae5061", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24802024-11-06T00:32:25.802ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24812024-11-06T00:32:25.804ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 309.953442ms iteration = 27 status = {}
24822024-11-06T00:32:25.805ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "02bd0b13-f97b-4502-8b73-43ec28a11018", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24832024-11-06T00:32:25.805ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24842024-11-06T00:32:25.806ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24852024-11-06T00:32:25.806ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24862024-11-06T00:32:25.806ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "452384dc-8561-4f92-adf5-5fd32ec48dad", "content-length": "372", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
24872024-11-06T00:32:25.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24882024-11-06T00:32:25.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24892024-11-06T00:32:25.807ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24902024-11-06T00:32:25.807ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 312.758445ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24912024-11-06T00:32:25.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24922024-11-06T00:32:25.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24932024-11-06T00:32:25.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24942024-11-06T00:32:25.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24952024-11-06T00:32:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24962024-11-06T00:32:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24972024-11-06T00:32:25.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24982024-11-06T00:32:25.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24992024-11-06T00:32:25.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25002024-11-06T00:32:25.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25012024-11-06T00:32:25.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25022024-11-06T00:32:25.815ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 49647dec-3431-42f3-8ea3-efc9338eb811 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
25032024-11-06T00:32:25.815ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25042024-11-06T00:32:25.815ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-06 00:19:32.804378 UTC dns_group = internal generation = 1
25052024-11-06T00:32:25.815ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 321.416673ms iteration = 14 status = {"generation":1}
25062024-11-06T00:32:25.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25072024-11-06T00:32:25.833ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25082024-11-06T00:32:25.833ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25092024-11-06T00:32:25.833ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4be13aa7-a40b-490e-af58-709cc3e91ab8", "content-length": "2", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
25102024-11-06T00:32:25.837ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25112024-11-06T00:32:25.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25122024-11-06T00:32:25.842ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 347.439454ms iteration = 27 status = null
25132024-11-06T00:32:25.868ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25142024-11-06T00:32:25.868ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25152024-11-06T00:32:25.869ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7de0af70-d970-4114-988f-eef5839584c1", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
25162024-11-06T00:32:25.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25172024-11-06T00:32:25.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25182024-11-06T00:32:25.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25192024-11-06T00:32:25.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25202024-11-06T00:32:25.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25212024-11-06T00:32:25.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25222024-11-06T00:32:25.878ZINFOnexus (BackgroundTasks): VPC route manager sled 7c647f25-eb29-494d-840d-11658133af45 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25232024-11-06T00:32:25.878ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25242024-11-06T00:32:25.878ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "12ff1eca-8012-4cce-962a-d88211295188", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
25252024-11-06T00:32:25.881ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 386.755443ms iteration = 28 status = {}
25262024-11-06T00:32:25.897ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25272024-11-06T00:32:25.898ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4fb114a9-8831-4fbd-a2a7-39f8d6f647ac", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25282024-11-06T00:32:25.898ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25292024-11-06T00:32:25.899ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c2521b02-3377-41fb-b412-bc6eebae0872", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25302024-11-06T00:32:25.899ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25312024-11-06T00:32:25.901ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c6aeac7c-c306-4e9e-b527-2d722d37e093", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25322024-11-06T00:32:25.901ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25332024-11-06T00:32:25.903ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25342024-11-06T00:32:25.903ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 408.971002ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25352024-11-06T00:32:25.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25362024-11-06T00:32:25.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25372024-11-06T00:32:25.959ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7ed6a6f7-38cc-42b2-88d6-7cb6b5242771, rack_id: 3a58cbfb-5015-41c2-9142-616f1a1558aa, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7114d987-4bc7-4ef3-9865-a938d8573d6b) } rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
25382024-11-06T00:32:25.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25392024-11-06T00:32:25.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25402024-11-06T00:32:25.961ZDEBGnexus (BackgroundTasks): client request SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25412024-11-06T00:32:25.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 7c647f25-eb29-494d-840d-11658133af45 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "26228809-8f51-4fe9-9af7-5e90fdeea03e", "content-length": "691", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
25422024-11-06T00:32:25.962ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
25432024-11-06T00:32:25.962ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25442024-11-06T00:32:25.962ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25452024-11-06T00:32:25.963ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 469.604872ms iteration = 28 status = {}
25462024-11-06T00:32:25.975ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25472024-11-06T00:32:25.975ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e18b408e-b0ad-41a5-84a2-092aeea65d60", "content-length": "121", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
25482024-11-06T00:32:25.975ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
25492024-11-06T00:32:25.975ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7114d987-4bc7-4ef3-9865-a938d8573d6b
25502024-11-06T00:32:25.976ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25512024-11-06T00:32:25.976ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25522024-11-06T00:32:25.976ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25532024-11-06T00:32:25.976ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25542024-11-06T00:32:25.976ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25552024-11-06T00:32:25.976ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25562024-11-06T00:32:25.976ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25572024-11-06T00:32:25.976ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25582024-11-06T00:32:25.976ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa
25592024-11-06T00:32:25.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25602024-11-06T00:32:25.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25612024-11-06T00:32:25.979ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25622024-11-06T00:32:25.979ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "93ea3364-5c69-4547-90a4-bb4add25246c", "content-length": "2", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
25632024-11-06T00:32:25.979ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25642024-11-06T00:32:25.979ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "72e36063-a3d3-46ae-97d9-229dbf14d0a1", "content-length": "52", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
25652024-11-06T00:32:25.979ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch_location = Switch0
25662024-11-06T00:32:25.979ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25672024-11-06T00:32:26.084ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1f9b8b5c-e8ca-4d87-89dd-e18718b5ef0b", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
25682024-11-06T00:32:26.084ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa switch = Switch0
25692024-11-06T00:32:26.084ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25702024-11-06T00:32:26.084ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a58cbfb-5015-41c2-9142-616f1a1558aa result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d8e3560-c54a-4876-a399-b5614f653202", "content-length": "669", "date": "Wed, 06 Nov 2024 00:32:25 GMT"} })
25712024-11-06T00:32:26.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25722024-11-06T00:32:26.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25732024-11-06T00:32:26.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25742024-11-06T00:32:26.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25752024-11-06T00:32:26.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25762024-11-06T00:32:26.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25772024-11-06T00:32:26.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25782024-11-06T00:32:26.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25792024-11-06T00:32:26.105ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 610.794114ms iteration = 27 status = {}
25802024-11-06T00:32:26.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7bdf4f2e-3ff2-4c03-ada7-3e3eb63945c8 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25812024-11-06T00:32:26.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7bdf4f2e-3ff2-4c03-ada7-3e3eb63945c8 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25822024-11-06T00:32:26.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7bdf4f2e-3ff2-4c03-ada7-3e3eb63945c8 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25832024-11-06T00:32:27.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 09126809-b974-4508-88a8-7bb2997ee6ca roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25842024-11-06T00:32:27.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 09126809-b974-4508-88a8-7bb2997ee6ca resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25852024-11-06T00:32:27.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 09126809-b974-4508-88a8-7bb2997ee6ca response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25862024-11-06T00:32:28.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ecdfce7b-6579-427a-a121-8e33bb8ff973 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25872024-11-06T00:32:28.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ecdfce7b-6579-427a-a121-8e33bb8ff973 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25882024-11-06T00:32:28.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ecdfce7b-6579-427a-a121-8e33bb8ff973 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25892024-11-06T00:32:29.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 147b303f-a354-400e-bdec-db5a8c32ab49 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25902024-11-06T00:32:29.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 147b303f-a354-400e-bdec-db5a8c32ab49 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25912024-11-06T00:32:29.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 147b303f-a354-400e-bdec-db5a8c32ab49 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25922024-11-06T00:32:30.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9fab56f5-a157-4052-bf89-980bf9f8c228 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25932024-11-06T00:32:30.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9fab56f5-a157-4052-bf89-980bf9f8c228 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25942024-11-06T00:32:30.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 9fab56f5-a157-4052-bf89-980bf9f8c228 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25952024-11-06T00:32:31.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1241 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = 758cdea6-109f-45ee-aaf7-65fbdcec395f response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
25962024-11-06T00:32:31.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8bc013a3-c1df-4323-928d-764284b7c80e roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25972024-11-06T00:32:31.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8bc013a3-c1df-4323-928d-764284b7c80e resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25982024-11-06T00:32:31.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8bc013a3-c1df-4323-928d-764284b7c80e response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
25992024-11-06T00:32:32.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fab78a3f-1f0f-4ab1-a64c-f59ad8647078 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26002024-11-06T00:32:32.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fab78a3f-1f0f-4ab1-a64c-f59ad8647078 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26012024-11-06T00:32:32.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fab78a3f-1f0f-4ab1-a64c-f59ad8647078 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26022024-11-06T00:32:33.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8306a371-ffb4-4432-9114-6b2f656edd43 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26032024-11-06T00:32:33.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8306a371-ffb4-4432-9114-6b2f656edd43 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26042024-11-06T00:32:33.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8306a371-ffb4-4432-9114-6b2f656edd43 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26052024-11-06T00:32:34.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 40326170-181f-44ae-985d-730f7c352d1d roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26062024-11-06T00:32:34.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 40326170-181f-44ae-985d-730f7c352d1d resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26072024-11-06T00:32:34.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 40326170-181f-44ae-985d-730f7c352d1d response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26082024-11-06T00:32:35.493ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
26092024-11-06T00:32:35.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26102024-11-06T00:32:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26112024-11-06T00:32:35.494ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
26122024-11-06T00:32:35.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26132024-11-06T00:32:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26142024-11-06T00:32:35.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26152024-11-06T00:32:35.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26162024-11-06T00:32:35.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26172024-11-06T00:32:35.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26182024-11-06T00:32:35.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26192024-11-06T00:32:35.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26202024-11-06T00:32:35.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26212024-11-06T00:32:35.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
26222024-11-06T00:32:35.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26232024-11-06T00:32:35.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26242024-11-06T00:32:35.516ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
26252024-11-06T00:32:35.516ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.174439ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
26262024-11-06T00:32:35.522ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26272024-11-06T00:32:35.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26282024-11-06T00:32:35.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.64419ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26292024-11-06T00:32:35.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c3de2d6b-ed4f-49b7-989f-b8c233009488 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26302024-11-06T00:32:35.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c3de2d6b-ed4f-49b7-989f-b8c233009488 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26312024-11-06T00:32:35.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = c3de2d6b-ed4f-49b7-989f-b8c233009488 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26322024-11-06T00:32:36.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7e9030b4-4de5-425c-b651-2b12656784c2 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26332024-11-06T00:32:36.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7e9030b4-4de5-425c-b651-2b12656784c2 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26342024-11-06T00:32:36.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 7e9030b4-4de5-425c-b651-2b12656784c2 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26352024-11-06T00:32:37.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 09a94801-9c2f-4de5-a329-f24dcfe552c0 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26362024-11-06T00:32:37.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 09a94801-9c2f-4de5-a329-f24dcfe552c0 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26372024-11-06T00:32:37.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 09a94801-9c2f-4de5-a329-f24dcfe552c0 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26382024-11-06T00:32:38.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 68f742fa-38da-40e6-b9e0-cf832e6fcdd7 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26392024-11-06T00:32:38.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 68f742fa-38da-40e6-b9e0-cf832e6fcdd7 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26402024-11-06T00:32:38.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 68f742fa-38da-40e6-b9e0-cf832e6fcdd7 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26412024-11-06T00:32:39.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 6fee0b68-77c7-4cb3-b541-607b117a3c70 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
26422024-11-06T00:32:39.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 6fee0b68-77c7-4cb3-b541-607b117a3c70 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
26432024-11-06T00:32:39.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64037 req_id = 6fee0b68-77c7-4cb3-b541-607b117a3c70 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
26442024-11-06T00:32:39.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 92ffd88a-fc97-4c71-acf1-4ab15568e6a8 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26452024-11-06T00:32:39.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 92ffd88a-fc97-4c71-acf1-4ab15568e6a8 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26462024-11-06T00:32:39.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 92ffd88a-fc97-4c71-acf1-4ab15568e6a8 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26472024-11-06T00:32:40.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 58d5132d-1b6c-4889-8288-d1d9a391d570 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26482024-11-06T00:32:40.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 58d5132d-1b6c-4889-8288-d1d9a391d570 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26492024-11-06T00:32:40.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 58d5132d-1b6c-4889-8288-d1d9a391d570 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26502024-11-06T00:32:41.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = bc3240f6-70cb-4b96-8c79-2f7041555261 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26512024-11-06T00:32:41.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = bc3240f6-70cb-4b96-8c79-2f7041555261 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26522024-11-06T00:32:41.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = bc3240f6-70cb-4b96-8c79-2f7041555261 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26532024-11-06T00:32:42.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 999f9f60-9193-4d51-94e0-e260052a8871 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26542024-11-06T00:32:42.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 999f9f60-9193-4d51-94e0-e260052a8871 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26552024-11-06T00:32:42.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 999f9f60-9193-4d51-94e0-e260052a8871 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26562024-11-06T00:32:43.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ab2b0ebb-321b-4546-a143-e5d3635aa4a4 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26572024-11-06T00:32:43.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ab2b0ebb-321b-4546-a143-e5d3635aa4a4 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26582024-11-06T00:32:43.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = ab2b0ebb-321b-4546-a143-e5d3635aa4a4 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26592024-11-06T00:32:44.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 39639f72-f8bd-4aec-a639-20667b99f0bd roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26602024-11-06T00:32:44.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 39639f72-f8bd-4aec-a639-20667b99f0bd resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26612024-11-06T00:32:44.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 39639f72-f8bd-4aec-a639-20667b99f0bd response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26622024-11-06T00:32:45.494ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
26632024-11-06T00:32:45.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26642024-11-06T00:32:45.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26652024-11-06T00:32:45.494ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
26662024-11-06T00:32:45.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26672024-11-06T00:32:45.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26682024-11-06T00:32:45.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26692024-11-06T00:32:45.522ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26702024-11-06T00:32:45.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26712024-11-06T00:32:45.524ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.717272ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26722024-11-06T00:32:45.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26732024-11-06T00:32:45.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26742024-11-06T00:32:45.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26752024-11-06T00:32:45.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26762024-11-06T00:32:45.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26772024-11-06T00:32:45.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26782024-11-06T00:32:45.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 542c6a13-dea0-484f-aa4f-d05b6e033846, lookup_type: ById(542c6a13-dea0-484f-aa4f-d05b6e033846) } result = Ok(())
26792024-11-06T00:32:45.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26802024-11-06T00:32:45.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26812024-11-06T00:32:45.568ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 original_time_created = 2024-11-06 00:19:10.103182 UTC target_id = 542c6a13-dea0-484f-aa4f-d05b6e033846 time_created = 2024-11-06 00:19:10.103182 UTC
26822024-11-06T00:32:45.568ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.536173ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"542c6a13-dea0-484f-aa4f-d05b6e033846","time_created":"2024-11-06T00:19:10.103182Z"}
26832024-11-06T00:32:45.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4d3394e0-f99b-4c2a-af15-f9bcb04ad033 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26842024-11-06T00:32:45.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4d3394e0-f99b-4c2a-af15-f9bcb04ad033 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26852024-11-06T00:32:45.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 4d3394e0-f99b-4c2a-af15-f9bcb04ad033 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26862024-11-06T00:32:46.467ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1029 local_addr = [fd00:1122:3344:101::c]:60110 method = GET remote_addr = [fd00:1122:3344:101::d]:57873 req_id = 0e391ed8-d8cc-4494-b3a1-d94289a9fd06 response_code = 200 uri = /f13e9b98-ae91-4d61-ba9b-3b178cfa151a
26872024-11-06T00:32:46.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 715ee0fc-2a76-430f-aeca-6d28322d79ea roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26882024-11-06T00:32:46.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 715ee0fc-2a76-430f-aeca-6d28322d79ea resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26892024-11-06T00:32:46.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 715ee0fc-2a76-430f-aeca-6d28322d79ea response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26902024-11-06T00:32:47.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fde9a9ec-f226-426e-9f41-f3f747a3253e roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26912024-11-06T00:32:47.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fde9a9ec-f226-426e-9f41-f3f747a3253e resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26922024-11-06T00:32:47.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = fde9a9ec-f226-426e-9f41-f3f747a3253e response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26932024-11-06T00:32:49.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 36930a5e-8e32-4ed7-89b0-82145e9cc5ae roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26942024-11-06T00:32:49.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 36930a5e-8e32-4ed7-89b0-82145e9cc5ae resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26952024-11-06T00:32:49.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 36930a5e-8e32-4ed7-89b0-82145e9cc5ae response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26962024-11-06T00:32:50.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e1cb2b09-e803-4749-8f7a-a8fc755b7fd4 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26972024-11-06T00:32:50.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e1cb2b09-e803-4749-8f7a-a8fc755b7fd4 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26982024-11-06T00:32:50.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = e1cb2b09-e803-4749-8f7a-a8fc755b7fd4 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
26992024-11-06T00:32:51.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 587248d5-4ece-48ee-b154-bf1bba3bfc55 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27002024-11-06T00:32:51.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 587248d5-4ece-48ee-b154-bf1bba3bfc55 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27012024-11-06T00:32:51.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 587248d5-4ece-48ee-b154-bf1bba3bfc55 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27022024-11-06T00:32:51.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = f242d012-f6a6-4d86-8b12-2da677f2746f roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
27032024-11-06T00:32:51.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = f242d012-f6a6-4d86-8b12-2da677f2746f resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
27042024-11-06T00:32:51.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = f242d012-f6a6-4d86-8b12-2da677f2746f response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?sort_by=id_ascending
27052024-11-06T00:32:51.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = d8387f99-628b-4813-93de-b3f11485dc7b roles = RoleSet { roles: {} } uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
27062024-11-06T00:32:51.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = d8387f99-628b-4813-93de-b3f11485dc7b resource = Database result = Ok(()) uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
27072024-11-06T00:32:51.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42339 req_id = d8387f99-628b-4813-93de-b3f11485dc7b response_code = 200 uri = /metrics/collectors/4e1b9b8b-9e08-4e6d-89c1-97aff5e8f01e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZWQzZWM3NC1hZjQyLTRkZjctOWY3MS0zOTU3ZjcxMDNkZmYifX0%3D
27082024-11-06T00:32:52.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8ff48450-4cdf-4648-9683-837d3d616799 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27092024-11-06T00:32:52.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8ff48450-4cdf-4648-9683-837d3d616799 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27102024-11-06T00:32:52.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 8ff48450-4cdf-4648-9683-837d3d616799 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27112024-11-06T00:32:53.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6aa08ca7-84cc-44ec-b9b1-ad36616dbf63 roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27122024-11-06T00:32:53.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6aa08ca7-84cc-44ec-b9b1-ad36616dbf63 resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27132024-11-06T00:32:53.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 6aa08ca7-84cc-44ec-b9b1-ad36616dbf63 response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27142024-11-06T00:32:54.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3a42cf51-0d30-40e5-91ef-1cf8ec5bd43e roles = RoleSet { roles: {} } uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27152024-11-06T00:32:54.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3a42cf51-0d30-40e5-91ef-1cf8ec5bd43e resource = Database result = Ok(()) uri = /probes/7c647f25-eb29-494d-840d-11658133af45
27162024-11-06T00:32:54.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64300 req_id = 3a42cf51-0d30-40e5-91ef-1cf8ec5bd43e response_code = 200 uri = /probes/7c647f25-eb29-494d-840d-11658133af45