Max level shown:
12024-12-20T22:15:01.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eb5dd411-45b7-4759-8871-c1dd91db560b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
22024-12-20T22:15:01.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eb5dd411-45b7-4759-8871-c1dd91db560b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32024-12-20T22:15:01.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eb5dd411-45b7-4759-8871-c1dd91db560b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
42024-12-20T22:15:02.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a1c9028d-96de-4b1d-bab2-f01a5dde1453 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52024-12-20T22:15:02.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a1c9028d-96de-4b1d-bab2-f01a5dde1453 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62024-12-20T22:15:02.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a1c9028d-96de-4b1d-bab2-f01a5dde1453 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
72024-12-20T22:15:03.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1ef35125-105a-4f4a-a7bc-82467d83f4c7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
82024-12-20T22:15:03.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1ef35125-105a-4f4a-a7bc-82467d83f4c7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92024-12-20T22:15:03.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1ef35125-105a-4f4a-a7bc-82467d83f4c7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102024-12-20T22:15:03.434ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
112024-12-20T22:15:03.434ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
122024-12-20T22:15:03.434ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132024-12-20T22:15:03.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142024-12-20T22:15:03.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
152024-12-20T22:15:03.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
162024-12-20T22:15:03.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
172024-12-20T22:15:03.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
182024-12-20T22:15:03.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
192024-12-20T22:15:03.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.499745ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
202024-12-20T22:15:03.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
212024-12-20T22:15:03.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222024-12-20T22:15:03.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
232024-12-20T22:15:03.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
242024-12-20T22:15:03.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
252024-12-20T22:15:03.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
262024-12-20T22:15:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
272024-12-20T22:15:03.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
282024-12-20T22:15:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
292024-12-20T22:15:03.456ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
302024-12-20T22:15:03.456ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.664678ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
312024-12-20T22:15:04.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c97ff515-23be-4d2d-b368-686948ec09ef roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
322024-12-20T22:15:04.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c97ff515-23be-4d2d-b368-686948ec09ef resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
332024-12-20T22:15:04.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c97ff515-23be-4d2d-b368-686948ec09ef response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
342024-12-20T22:15:05.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c0286dbc-1171-4b2b-9e71-c726961bb905 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
352024-12-20T22:15:05.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c0286dbc-1171-4b2b-9e71-c726961bb905 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
362024-12-20T22:15:05.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c0286dbc-1171-4b2b-9e71-c726961bb905 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
372024-12-20T22:15:05.679ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:62662 remote_addr = [fd00:1122:3344:101::d]:40610
382024-12-20T22:15:05.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8333 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 06b71a8d-f6ca-42f5-9124-d0357088a3b5 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
392024-12-20T22:15:06.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa166bcf-16d5-4027-9619-aaea40293331 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
402024-12-20T22:15:06.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa166bcf-16d5-4027-9619-aaea40293331 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
412024-12-20T22:15:06.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa166bcf-16d5-4027-9619-aaea40293331 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
422024-12-20T22:15:07.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 02720727-c810-4484-a73e-a3c63c79f886 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
432024-12-20T22:15:07.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 02720727-c810-4484-a73e-a3c63c79f886 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
442024-12-20T22:15:07.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 02720727-c810-4484-a73e-a3c63c79f886 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
452024-12-20T22:15:08.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6babf03c-d898-4c8d-b50c-5a1f599ea667 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
462024-12-20T22:15:08.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6babf03c-d898-4c8d-b50c-5a1f599ea667 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
472024-12-20T22:15:08.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6babf03c-d898-4c8d-b50c-5a1f599ea667 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
482024-12-20T22:15:08.607ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::7]:32222/node/id", source: TimedOut })
492024-12-20T22:15:08.608ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 15.046838311s iteration = 2 status = {"errors":[{"err":"failed to fetch node ID for zone e62e1c50-8a6d-4820-b3b9-f7743267bb97 at http://[fd00:1122:3344:101::7]:32222: Communication Error: error sending request for url (http://[fd00:1122:3344:101::7]:32222/node/id): error sending request for url (http://[fd00:1122:3344:101::7]:32222/node/id): operation timed out","zone_id":"e62e1c50-8a6d-4820-b3b9-f7743267bb97"}],"nsuccess":4}
502024-12-20T22:15:09.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aada5587-d55c-4e2b-b551-c21b0bc489e3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
512024-12-20T22:15:09.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aada5587-d55c-4e2b-b551-c21b0bc489e3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
522024-12-20T22:15:09.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aada5587-d55c-4e2b-b551-c21b0bc489e3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
532024-12-20T22:15:10.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e0ddc5b9-4a17-45b4-8ae1-b9b36b59cec7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
542024-12-20T22:15:10.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e0ddc5b9-4a17-45b4-8ae1-b9b36b59cec7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
552024-12-20T22:15:10.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e0ddc5b9-4a17-45b4-8ae1-b9b36b59cec7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
562024-12-20T22:15:10.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 9389be9a-0433-4df6-9e1f-7555ede06943 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
572024-12-20T22:15:10.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 9389be9a-0433-4df6-9e1f-7555ede06943 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
582024-12-20T22:15:10.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 9389be9a-0433-4df6-9e1f-7555ede06943 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
592024-12-20T22:15:10.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = f01507f7-5aa3-4285-b914-b649f35243f7 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhMGE3ODBjMy0wODA2LTQwNDQtOGU0Yi1lOTFiZjA0MDUyMjEifX0%3D
602024-12-20T22:15:10.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = f01507f7-5aa3-4285-b914-b649f35243f7 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhMGE3ODBjMy0wODA2LTQwNDQtOGU0Yi1lOTFiZjA0MDUyMjEifX0%3D
612024-12-20T22:15:10.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = f01507f7-5aa3-4285-b914-b649f35243f7 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhMGE3ODBjMy0wODA2LTQwNDQtOGU0Yi1lOTFiZjA0MDUyMjEifX0%3D
622024-12-20T22:15:11.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 00255b83-dcfc-402f-84fe-f97119fbdb61 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
632024-12-20T22:15:11.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 00255b83-dcfc-402f-84fe-f97119fbdb61 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
642024-12-20T22:15:11.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 00255b83-dcfc-402f-84fe-f97119fbdb61 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
652024-12-20T22:15:12.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 406afa7b-0680-4a45-b71d-e5c1b673c228 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
662024-12-20T22:15:12.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 406afa7b-0680-4a45-b71d-e5c1b673c228 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
672024-12-20T22:15:12.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 406afa7b-0680-4a45-b71d-e5c1b673c228 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
682024-12-20T22:15:13.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 69f21fd5-2b71-4060-b430-b20d1a52f05d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
692024-12-20T22:15:13.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 69f21fd5-2b71-4060-b430-b20d1a52f05d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
702024-12-20T22:15:13.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 69f21fd5-2b71-4060-b430-b20d1a52f05d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
712024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
722024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
732024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
742024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
752024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
762024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
772024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
782024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
792024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
802024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
812024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
822024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
832024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
842024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
852024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
862024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
872024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
882024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
892024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
902024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
912024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
922024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
932024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
942024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
952024-12-20T22:15:13.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
962024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
972024-12-20T22:15:13.435ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
982024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
992024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.051\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
1002024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
1012024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1022024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
1032024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1042024-12-20T22:15:13.435ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1052024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
1062024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1072024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1082024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
1092024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
1102024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1112024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1122024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
1132024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1142024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
1152024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1162024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
1172024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
1182024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
1192024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1202024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1212024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
1222024-12-20T22:15:13.435ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:05:13.435070457 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1232024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
1242024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1252024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1262024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
1272024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
1282024-12-20T22:15:13.435ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1292024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
1302024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1312024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1322024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
1332024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1342024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1352024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1362024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1372024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1382024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1392024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1402024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1412024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1422024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1432024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1442024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1452024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1462024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1472024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1482024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1492024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1502024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1512024-12-20T22:15:13.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1522024-12-20T22:15:13.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1532024-12-20T22:15:13.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1542024-12-20T22:15:13.436ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 940, tv_nsec: 371153285 } })
1552024-12-20T22:15:13.436ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 940, tv_nsec: 371156845 } })
1562024-12-20T22:15:13.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1572024-12-20T22:15:13.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1582024-12-20T22:15:13.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1592024-12-20T22:15:13.436ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1602024-12-20T22:15:13.436ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.602786ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1612024-12-20T22:15:13.436ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
1622024-12-20T22:15:13.436ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.778498ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
1632024-12-20T22:15:13.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1642024-12-20T22:15:13.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1652024-12-20T22:15:13.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1662024-12-20T22:15:13.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1672024-12-20T22:15:13.439ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.948169ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1682024-12-20T22:15:13.440ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 940, tv_nsec: 375418768 } })
1692024-12-20T22:15:13.440ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1702024-12-20T22:15:13.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1712024-12-20T22:15:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1722024-12-20T22:15:13.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1732024-12-20T22:15:13.447ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.787069ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
1742024-12-20T22:15:13.447ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:05:13.435070457 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1752024-12-20T22:15:13.447ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.818898ms iteration = 2 status = {"expiration":"2024-12-20T22:05:13.435070457Z","pruned":[]}
1762024-12-20T22:15:13.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1772024-12-20T22:15:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1782024-12-20T22:15:13.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1792024-12-20T22:15:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1802024-12-20T22:15:13.450ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1812024-12-20T22:15:13.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1822024-12-20T22:15:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1832024-12-20T22:15:13.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1842024-12-20T22:15:13.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 940, tv_nsec: 390520990 } })
1852024-12-20T22:15:13.455ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1862024-12-20T22:15:13.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1872024-12-20T22:15:13.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1882024-12-20T22:15:13.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1892024-12-20T22:15:13.462ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1902024-12-20T22:15:13.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1912024-12-20T22:15:13.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.738901ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
1922024-12-20T22:15:13.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.55922ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
1932024-12-20T22:15:13.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1942024-12-20T22:15:13.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1952024-12-20T22:15:13.499ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1962024-12-20T22:15:13.499ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1972024-12-20T22:15:13.499ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1982024-12-20T22:15:13.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1992024-12-20T22:15:13.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2002024-12-20T22:15:13.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2012024-12-20T22:15:13.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2022024-12-20T22:15:13.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2032024-12-20T22:15:13.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2042024-12-20T22:15:13.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
2052024-12-20T22:15:13.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2062024-12-20T22:15:13.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2072024-12-20T22:15:13.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2082024-12-20T22:15:13.510ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2092024-12-20T22:15:13.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2102024-12-20T22:15:13.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2112024-12-20T22:15:13.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2122024-12-20T22:15:13.515ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2132024-12-20T22:15:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2142024-12-20T22:15:13.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2152024-12-20T22:15:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2162024-12-20T22:15:13.518ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2172024-12-20T22:15:13.518ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2182024-12-20T22:15:13.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2192024-12-20T22:15:13.519ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2202024-12-20T22:15:13.520ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2212024-12-20T22:15:13.520ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2222024-12-20T22:15:13.520ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2232024-12-20T22:15:13.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2242024-12-20T22:15:13.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2252024-12-20T22:15:13.522ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2262024-12-20T22:15:13.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2272024-12-20T22:15:13.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.961926ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2282024-12-20T22:15:13.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2292024-12-20T22:15:13.537ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2302024-12-20T22:15:13.537ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2312024-12-20T22:15:13.537ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 102.842435ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2322024-12-20T22:15:13.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2332024-12-20T22:15:13.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2342024-12-20T22:15:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2352024-12-20T22:15:13.540ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 940, tv_nsec: 475606686 } })
2362024-12-20T22:15:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2372024-12-20T22:15:13.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2382024-12-20T22:15:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2392024-12-20T22:15:13.541ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2402024-12-20T22:15:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2412024-12-20T22:15:13.542ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2422024-12-20T22:15:13.543ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
2432024-12-20T22:15:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2442024-12-20T22:15:13.545ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2452024-12-20T22:15:13.545ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2462024-12-20T22:15:13.545ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2472024-12-20T22:15:13.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2482024-12-20T22:15:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2492024-12-20T22:15:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2502024-12-20T22:15:13.546ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2512024-12-20T22:15:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2522024-12-20T22:15:13.548ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
2532024-12-20T22:15:13.548ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.327621ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
2542024-12-20T22:15:13.548ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
2552024-12-20T22:15:13.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 115.524623ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2562024-12-20T22:15:13.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2572024-12-20T22:15:13.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2582024-12-20T22:15:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2592024-12-20T22:15:13.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2602024-12-20T22:15:13.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2612024-12-20T22:15:13.555ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2622024-12-20T22:15:13.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2632024-12-20T22:15:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2642024-12-20T22:15:13.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2652024-12-20T22:15:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2662024-12-20T22:15:13.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2672024-12-20T22:15:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2682024-12-20T22:15:13.558ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
2692024-12-20T22:15:13.558ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
2702024-12-20T22:15:13.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2712024-12-20T22:15:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2722024-12-20T22:15:13.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2732024-12-20T22:15:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2742024-12-20T22:15:13.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2752024-12-20T22:15:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2762024-12-20T22:15:13.567ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2772024-12-20T22:15:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2782024-12-20T22:15:13.571ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
2792024-12-20T22:15:13.571ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 136.678885ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
2802024-12-20T22:15:13.573ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2812024-12-20T22:15:13.573ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2822024-12-20T22:15:13.573ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f018a2bf-49f7-41bb-8006-34c93db28d41", "content-length": "26", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
2832024-12-20T22:15:13.573ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2842024-12-20T22:15:13.575ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2852024-12-20T22:15:13.579ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2862024-12-20T22:15:13.579ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2872024-12-20T22:15:13.579ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c049c6c-ec42-4428-8e9d-4a165523a6db", "content-length": "26", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
2882024-12-20T22:15:13.579ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2892024-12-20T22:15:13.580ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2902024-12-20T22:15:13.580ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 145.163561ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2912024-12-20T22:15:13.581ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2922024-12-20T22:15:13.584ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
2932024-12-20T22:15:13.584ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
2942024-12-20T22:15:13.585ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
2952024-12-20T22:15:13.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 150.270832ms iteration = 3 status = {"generation":1}
2962024-12-20T22:15:13.592ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
2972024-12-20T22:15:13.600ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2982024-12-20T22:15:13.600ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2992024-12-20T22:15:13.600ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 165.661767ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3002024-12-20T22:15:13.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 169.074421ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3012024-12-20T22:15:13.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3022024-12-20T22:15:13.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3032024-12-20T22:15:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3042024-12-20T22:15:13.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3052024-12-20T22:15:13.617ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3062024-12-20T22:15:13.617ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3072024-12-20T22:15:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3082024-12-20T22:15:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3092024-12-20T22:15:13.620ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3102024-12-20T22:15:13.620ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3112024-12-20T22:15:13.620ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 185.641539ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3122024-12-20T22:15:13.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3132024-12-20T22:15:13.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3142024-12-20T22:15:13.625ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3152024-12-20T22:15:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3162024-12-20T22:15:13.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3172024-12-20T22:15:13.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3182024-12-20T22:15:13.636ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3192024-12-20T22:15:13.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3202024-12-20T22:15:13.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3212024-12-20T22:15:13.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3222024-12-20T22:15:13.648ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3232024-12-20T22:15:13.648ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3242024-12-20T22:15:13.648ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3252024-12-20T22:15:13.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3262024-12-20T22:15:13.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3272024-12-20T22:15:13.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3282024-12-20T22:15:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3292024-12-20T22:15:13.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3302024-12-20T22:15:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3312024-12-20T22:15:13.677ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 242.787303ms iteration = 6 status = {"physical_disks_added":0}
3322024-12-20T22:15:13.679ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
3332024-12-20T22:15:13.679ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 244.717263ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3342024-12-20T22:15:13.700ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
3352024-12-20T22:15:13.700ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3362024-12-20T22:15:13.700ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "abe711bf-a999-49eb-80cd-178a12c98733", "content-length": "26", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
3372024-12-20T22:15:13.700ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3382024-12-20T22:15:13.702ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
3392024-12-20T22:15:13.710ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3402024-12-20T22:15:13.729ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3412024-12-20T22:15:13.730ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "02342a28-49bf-4b1a-860b-74f6606e7af2", "content-length": "1", "date": "Fri, 20 Dec 2024 22:15:12 GMT"} })
3422024-12-20T22:15:13.732ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3432024-12-20T22:15:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3442024-12-20T22:15:13.734ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 300.13289ms iteration = 3 status = {}
3452024-12-20T22:15:13.765ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3462024-12-20T22:15:13.766ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f742cd47-2697-4ed7-b6ac-f30a3e48882a", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3472024-12-20T22:15:13.766ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3482024-12-20T22:15:13.768ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2c2acd38-1b42-4b9c-ab53-52771a043ee0", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3492024-12-20T22:15:13.768ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3502024-12-20T22:15:13.771ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3512024-12-20T22:15:13.771ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3522024-12-20T22:15:13.771ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3532024-12-20T22:15:13.771ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 336.716459ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3542024-12-20T22:15:13.772ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "647789ed-50e0-4547-85c6-919be6245653", "content-length": "372", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
3552024-12-20T22:15:13.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3562024-12-20T22:15:13.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3572024-12-20T22:15:13.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3582024-12-20T22:15:13.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3592024-12-20T22:15:13.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3602024-12-20T22:15:13.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3612024-12-20T22:15:13.777ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3622024-12-20T22:15:13.777ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 342.599108ms iteration = 3 status = null
3632024-12-20T22:15:13.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3642024-12-20T22:15:13.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3652024-12-20T22:15:13.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3662024-12-20T22:15:13.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3672024-12-20T22:15:13.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3682024-12-20T22:15:13.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3692024-12-20T22:15:13.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
3702024-12-20T22:15:13.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3712024-12-20T22:15:13.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3722024-12-20T22:15:13.800ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 365.380288ms iteration = 3 status = 0
3732024-12-20T22:15:13.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 383.603311ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
3742024-12-20T22:15:13.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
3752024-12-20T22:15:13.828ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "28532bfc-3794-4640-a182-65b19a85cbf8", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3762024-12-20T22:15:13.828ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3772024-12-20T22:15:13.830ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f128b859-4b11-44b2-b461-e388f4b29f4e", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3782024-12-20T22:15:13.830ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3792024-12-20T22:15:13.831ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f22eba73-4db5-4bdf-aa0b-0c06574c569d", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3802024-12-20T22:15:13.831ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3812024-12-20T22:15:13.833ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3822024-12-20T22:15:13.833ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 398.689303ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
3832024-12-20T22:15:13.843ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3842024-12-20T22:15:13.843ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
3852024-12-20T22:15:13.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3862024-12-20T22:15:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3872024-12-20T22:15:13.882ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
3882024-12-20T22:15:13.882ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3892024-12-20T22:15:13.883ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6016b5c6-f492-4ce9-89cf-43cc11b5925b", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
3902024-12-20T22:15:13.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3912024-12-20T22:15:13.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3922024-12-20T22:15:13.920ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3932024-12-20T22:15:13.921ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c2d4b30-720e-4bdb-b9e8-f9011b484a4d", "content-length": "691", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
3942024-12-20T22:15:13.921ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
3952024-12-20T22:15:13.921ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3962024-12-20T22:15:13.921ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3972024-12-20T22:15:13.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3982024-12-20T22:15:13.922ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 487.694728ms iteration = 3 status = {}
3992024-12-20T22:15:13.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4002024-12-20T22:15:13.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4012024-12-20T22:15:13.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4022024-12-20T22:15:13.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4032024-12-20T22:15:13.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4042024-12-20T22:15:13.928ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
4052024-12-20T22:15:13.928ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4062024-12-20T22:15:13.928ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
4072024-12-20T22:15:13.928ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 493.684858ms iteration = 3 status = {"generation":2}
4082024-12-20T22:15:13.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4092024-12-20T22:15:13.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4102024-12-20T22:15:13.933ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4112024-12-20T22:15:13.933ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4122024-12-20T22:15:13.934ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dea934e3-b0b9-4cf5-bda8-11927c0780f9", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
4132024-12-20T22:15:13.935ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 500.944842ms iteration = 4 status = {}
4142024-12-20T22:15:13.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4152024-12-20T22:15:13.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4162024-12-20T22:15:13.984ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
4172024-12-20T22:15:13.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4182024-12-20T22:15:13.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4192024-12-20T22:15:13.993ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4202024-12-20T22:15:13.995ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "01dac624-d50e-49a6-96dc-c7f1b96e1ec6", "content-length": "134", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
4212024-12-20T22:15:13.995ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4222024-12-20T22:15:13.995ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
4232024-12-20T22:15:13.995ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4242024-12-20T22:15:13.995ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4252024-12-20T22:15:13.995ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4262024-12-20T22:15:13.995ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4272024-12-20T22:15:13.995ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4282024-12-20T22:15:13.995ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4292024-12-20T22:15:13.998ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4302024-12-20T22:15:13.998ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4312024-12-20T22:15:13.998ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
4322024-12-20T22:15:13.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4332024-12-20T22:15:13.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4342024-12-20T22:15:14.010ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4352024-12-20T22:15:14.010ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "841f69a4-53d9-48e2-bbc0-d250c4a3656c", "content-length": "2", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
4362024-12-20T22:15:14.010ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4372024-12-20T22:15:14.010ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bcfceba-dbb4-4a4d-bded-f2d4439753cf", "content-length": "52", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
4382024-12-20T22:15:14.010ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
4392024-12-20T22:15:14.010ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4402024-12-20T22:15:14.166ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6b118fab-09f0-40fb-8b86-dc03a81c7837", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
4412024-12-20T22:15:14.166ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
4422024-12-20T22:15:14.166ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4432024-12-20T22:15:14.168ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "457e056b-93ef-49c1-b034-d0c675bcce0b", "content-length": "539", "date": "Fri, 20 Dec 2024 22:15:14 GMT"} })
4442024-12-20T22:15:14.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4452024-12-20T22:15:14.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4462024-12-20T22:15:14.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4472024-12-20T22:15:14.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4482024-12-20T22:15:14.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4492024-12-20T22:15:14.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4502024-12-20T22:15:14.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4512024-12-20T22:15:14.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4522024-12-20T22:15:14.210ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1229 key = network_key rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
4532024-12-20T22:15:14.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4542024-12-20T22:15:14.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4552024-12-20T22:15:14.223ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None }], switch: Switch0, tx_eq: None, uplink_port_fec: Some(None), uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1286 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
4562024-12-20T22:15:14.223ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4572024-12-20T22:15:14.298ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "d14b8668-15d9-4e43-9268-27d3d9239d20", "date": "Fri, 20 Dec 2024 22:15:13 GMT"} })
4582024-12-20T22:15:14.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4592024-12-20T22:15:14.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4602024-12-20T22:15:14.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 2d84aafc-d6c8-4088-b824-c71587aaa209 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4612024-12-20T22:15:14.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 2d84aafc-d6c8-4088-b824-c71587aaa209 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4622024-12-20T22:15:14.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 2d84aafc-d6c8-4088-b824-c71587aaa209 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4632024-12-20T22:15:14.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 40693775-0cb8-4ad0-a1a8-46b4bedfe5b1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
4642024-12-20T22:15:14.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 40693775-0cb8-4ad0-a1a8-46b4bedfe5b1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
4652024-12-20T22:15:14.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 40693775-0cb8-4ad0-a1a8-46b4bedfe5b1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
4662024-12-20T22:15:14.317ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 882.025527ms iteration = 3 status = {}
4672024-12-20T22:15:14.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a81b0625-92eb-4bee-a674-60327ed59325 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4682024-12-20T22:15:14.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a81b0625-92eb-4bee-a674-60327ed59325 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4692024-12-20T22:15:14.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a81b0625-92eb-4bee-a674-60327ed59325 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4702024-12-20T22:15:15.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5a69e928-e82d-4d46-a80f-6f0ba6fd1a62 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4712024-12-20T22:15:15.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5a69e928-e82d-4d46-a80f-6f0ba6fd1a62 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4722024-12-20T22:15:15.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5a69e928-e82d-4d46-a80f-6f0ba6fd1a62 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4732024-12-20T22:15:15.680ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1309 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 3fc032fe-c772-425e-b552-375d6a3883e5 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
4742024-12-20T22:15:16.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af32a3ca-be95-4d89-9237-c4ed94ca2056 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4752024-12-20T22:15:16.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af32a3ca-be95-4d89-9237-c4ed94ca2056 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4762024-12-20T22:15:16.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af32a3ca-be95-4d89-9237-c4ed94ca2056 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4772024-12-20T22:15:17.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2328b2b4-508e-4f6c-9dc8-e49e9a58bca0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4782024-12-20T22:15:17.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2328b2b4-508e-4f6c-9dc8-e49e9a58bca0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4792024-12-20T22:15:17.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2328b2b4-508e-4f6c-9dc8-e49e9a58bca0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4802024-12-20T22:15:18.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f82f2b1c-5d0b-4ea3-b702-6ae57ba5a063 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4812024-12-20T22:15:18.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f82f2b1c-5d0b-4ea3-b702-6ae57ba5a063 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4822024-12-20T22:15:18.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f82f2b1c-5d0b-4ea3-b702-6ae57ba5a063 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4832024-12-20T22:15:19.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7534a9e6-44ef-4760-9fb6-ed9cb482923d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4842024-12-20T22:15:19.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7534a9e6-44ef-4760-9fb6-ed9cb482923d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4852024-12-20T22:15:19.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7534a9e6-44ef-4760-9fb6-ed9cb482923d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4862024-12-20T22:15:20.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0b5abb40-bf69-4aba-b7d6-dde6ee3e91af roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4872024-12-20T22:15:20.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0b5abb40-bf69-4aba-b7d6-dde6ee3e91af resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4882024-12-20T22:15:20.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0b5abb40-bf69-4aba-b7d6-dde6ee3e91af response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4892024-12-20T22:15:21.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dda08326-752d-42f3-a05b-a9b3719dbfa4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4902024-12-20T22:15:21.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dda08326-752d-42f3-a05b-a9b3719dbfa4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4912024-12-20T22:15:21.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dda08326-752d-42f3-a05b-a9b3719dbfa4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4922024-12-20T22:15:22.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 071ab3b0-0221-43fd-b68d-51a58f75fd93 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4932024-12-20T22:15:22.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 071ab3b0-0221-43fd-b68d-51a58f75fd93 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4942024-12-20T22:15:22.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 071ab3b0-0221-43fd-b68d-51a58f75fd93 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
4952024-12-20T22:15:23.435ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
4962024-12-20T22:15:23.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
4972024-12-20T22:15:23.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4982024-12-20T22:15:23.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4992024-12-20T22:15:23.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5002024-12-20T22:15:23.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5012024-12-20T22:15:23.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5022024-12-20T22:15:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5032024-12-20T22:15:23.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5042024-12-20T22:15:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5052024-12-20T22:15:23.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5062024-12-20T22:15:23.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5072024-12-20T22:15:23.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5082024-12-20T22:15:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
5092024-12-20T22:15:23.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5102024-12-20T22:15:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5112024-12-20T22:15:23.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
5122024-12-20T22:15:23.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.8907ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
5132024-12-20T22:15:23.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5142024-12-20T22:15:23.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5152024-12-20T22:15:23.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.872411ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5162024-12-20T22:15:23.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 03cdaad7-82be-4acd-8c57-c164f7286c09 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5172024-12-20T22:15:23.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 03cdaad7-82be-4acd-8c57-c164f7286c09 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5182024-12-20T22:15:23.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 03cdaad7-82be-4acd-8c57-c164f7286c09 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5192024-12-20T22:15:24.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9bccabae-f7c7-456e-b9bb-4d98e4dc9f39 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5202024-12-20T22:15:24.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9bccabae-f7c7-456e-b9bb-4d98e4dc9f39 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5212024-12-20T22:15:24.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9bccabae-f7c7-456e-b9bb-4d98e4dc9f39 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5222024-12-20T22:15:25.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3bd9815a-26c1-4063-bc07-a8fe13f163cc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5232024-12-20T22:15:25.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3bd9815a-26c1-4063-bc07-a8fe13f163cc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5242024-12-20T22:15:25.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3bd9815a-26c1-4063-bc07-a8fe13f163cc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5252024-12-20T22:15:25.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b0b37705-98d6-4e8c-a7bd-91c1ebbcbf28 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
5262024-12-20T22:15:25.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b0b37705-98d6-4e8c-a7bd-91c1ebbcbf28 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
5272024-12-20T22:15:25.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b0b37705-98d6-4e8c-a7bd-91c1ebbcbf28 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
5282024-12-20T22:15:25.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 96478406-cd5e-4f4d-89d7-a2b091862233 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
5292024-12-20T22:15:25.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 96478406-cd5e-4f4d-89d7-a2b091862233 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
5302024-12-20T22:15:25.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 96478406-cd5e-4f4d-89d7-a2b091862233 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
5312024-12-20T22:15:25.681ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1450 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 1252b79d-b929-4e50-9ee2-4e911fa74b47 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
5322024-12-20T22:15:26.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 20da8a9e-f898-4575-a44b-87f6b9eb4057 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5332024-12-20T22:15:26.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 20da8a9e-f898-4575-a44b-87f6b9eb4057 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5342024-12-20T22:15:26.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 20da8a9e-f898-4575-a44b-87f6b9eb4057 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5352024-12-20T22:15:27.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5dd65299-6dd6-4f8a-91b7-c0caa1c33c96 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5362024-12-20T22:15:27.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5dd65299-6dd6-4f8a-91b7-c0caa1c33c96 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5372024-12-20T22:15:27.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5dd65299-6dd6-4f8a-91b7-c0caa1c33c96 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5382024-12-20T22:15:28.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 73cf36b8-dbb3-4a84-834f-c396cd6be70c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5392024-12-20T22:15:28.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 73cf36b8-dbb3-4a84-834f-c396cd6be70c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5402024-12-20T22:15:28.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 73cf36b8-dbb3-4a84-834f-c396cd6be70c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5412024-12-20T22:15:29.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 438d1c85-a025-4e28-9e38-34787bbe3665 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5422024-12-20T22:15:29.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 438d1c85-a025-4e28-9e38-34787bbe3665 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5432024-12-20T22:15:29.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 438d1c85-a025-4e28-9e38-34787bbe3665 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5442024-12-20T22:15:30.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 988ed433-e7f8-406e-803d-e9af2daace49 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5452024-12-20T22:15:30.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 988ed433-e7f8-406e-803d-e9af2daace49 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5462024-12-20T22:15:30.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 988ed433-e7f8-406e-803d-e9af2daace49 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5472024-12-20T22:15:31.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6612a9f9-4870-43a0-9006-9e72594cbf64 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5482024-12-20T22:15:31.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6612a9f9-4870-43a0-9006-9e72594cbf64 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5492024-12-20T22:15:31.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6612a9f9-4870-43a0-9006-9e72594cbf64 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5502024-12-20T22:15:32.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 24811eb9-36fb-42a8-bb65-20c5b05bad04 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5512024-12-20T22:15:32.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 24811eb9-36fb-42a8-bb65-20c5b05bad04 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5522024-12-20T22:15:32.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 24811eb9-36fb-42a8-bb65-20c5b05bad04 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5532024-12-20T22:15:33.434ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
5542024-12-20T22:15:33.434ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5552024-12-20T22:15:33.434ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
5562024-12-20T22:15:33.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5572024-12-20T22:15:33.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5582024-12-20T22:15:33.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5592024-12-20T22:15:33.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5602024-12-20T22:15:33.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5612024-12-20T22:15:33.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5622024-12-20T22:15:33.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.719838ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5632024-12-20T22:15:33.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5642024-12-20T22:15:33.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5652024-12-20T22:15:33.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5662024-12-20T22:15:33.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5672024-12-20T22:15:33.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5682024-12-20T22:15:33.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692024-12-20T22:15:33.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
5702024-12-20T22:15:33.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5712024-12-20T22:15:33.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5722024-12-20T22:15:33.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
5732024-12-20T22:15:33.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.88573ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
5742024-12-20T22:15:33.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cdcaf379-05fc-405a-ac6e-174667ee80f8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5752024-12-20T22:15:33.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cdcaf379-05fc-405a-ac6e-174667ee80f8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5762024-12-20T22:15:33.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cdcaf379-05fc-405a-ac6e-174667ee80f8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5772024-12-20T22:15:34.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d35ef0d9-58dd-4a22-9ff1-c635ac7b40cb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5782024-12-20T22:15:34.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d35ef0d9-58dd-4a22-9ff1-c635ac7b40cb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5792024-12-20T22:15:34.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d35ef0d9-58dd-4a22-9ff1-c635ac7b40cb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5802024-12-20T22:15:35.681ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1412 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = a8836f29-8284-4bf7-b49d-e72cb2a81426 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
5812024-12-20T22:15:35.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 19106a48-1994-4184-a0b8-e3fdcb4b423f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5822024-12-20T22:15:35.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 19106a48-1994-4184-a0b8-e3fdcb4b423f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5832024-12-20T22:15:35.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 19106a48-1994-4184-a0b8-e3fdcb4b423f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5842024-12-20T22:15:36.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 665ba596-612b-4752-807f-0690373cd97e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5852024-12-20T22:15:36.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 665ba596-612b-4752-807f-0690373cd97e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5862024-12-20T22:15:36.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 665ba596-612b-4752-807f-0690373cd97e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5872024-12-20T22:15:37.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1a4381f8-4d27-4b3a-88be-a576f4560b46 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5882024-12-20T22:15:37.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1a4381f8-4d27-4b3a-88be-a576f4560b46 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5892024-12-20T22:15:37.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1a4381f8-4d27-4b3a-88be-a576f4560b46 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5902024-12-20T22:15:38.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5a4c816f-f1ca-4add-9e89-e3c7e01bb75e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5912024-12-20T22:15:38.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5a4c816f-f1ca-4add-9e89-e3c7e01bb75e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5922024-12-20T22:15:38.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5a4c816f-f1ca-4add-9e89-e3c7e01bb75e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5932024-12-20T22:15:39.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c0b183b0-5710-4635-a02f-ab6d7bdcb0af roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5942024-12-20T22:15:39.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c0b183b0-5710-4635-a02f-ab6d7bdcb0af resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5952024-12-20T22:15:39.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c0b183b0-5710-4635-a02f-ab6d7bdcb0af response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
5962024-12-20T22:15:40.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d29ec297-bcd4-496e-b1d7-0d46a5961dc6 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
5972024-12-20T22:15:40.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d29ec297-bcd4-496e-b1d7-0d46a5961dc6 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
5982024-12-20T22:15:40.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d29ec297-bcd4-496e-b1d7-0d46a5961dc6 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
5992024-12-20T22:15:40.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 6a67cf96-8cad-4509-8e9d-e055383d0284 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
6002024-12-20T22:15:40.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 6a67cf96-8cad-4509-8e9d-e055383d0284 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
6012024-12-20T22:15:40.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 6a67cf96-8cad-4509-8e9d-e055383d0284 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
6022024-12-20T22:15:40.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f6051782-7b28-43e1-9f93-4c15baea550e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
6032024-12-20T22:15:40.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f6051782-7b28-43e1-9f93-4c15baea550e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
6042024-12-20T22:15:40.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f6051782-7b28-43e1-9f93-4c15baea550e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
6052024-12-20T22:15:41.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5cb19e40-7e02-4fa4-8db1-75bb58de1ebe roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
6062024-12-20T22:15:41.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5cb19e40-7e02-4fa4-8db1-75bb58de1ebe resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
6072024-12-20T22:15:41.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5cb19e40-7e02-4fa4-8db1-75bb58de1ebe response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
6082024-12-20T22:15:43.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa9bf873-3167-4cd7-a242-624a783d9f1d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
6092024-12-20T22:15:43.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa9bf873-3167-4cd7-a242-624a783d9f1d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
6102024-12-20T22:15:43.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa9bf873-3167-4cd7-a242-624a783d9f1d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
6112024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
6122024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6132024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6142024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
6152024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6162024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
6172024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6182024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
6192024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
6202024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6212024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
6222024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6232024-12-20T22:15:43.435ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6242024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
6252024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6262024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6272024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
6282024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6292024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
6302024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6312024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
6322024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6332024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
6342024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6352024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
6362024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6372024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
6382024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6392024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
6402024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6412024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
6422024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
6432024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6442024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
6452024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6462024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6472024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6482024-12-20T22:15:43.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6492024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6502024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6512024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6522024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6532024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6542024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6552024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6562024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6572024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
6582024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6592024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6602024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6612024-12-20T22:15:43.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
6622024-12-20T22:15:43.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6632024-12-20T22:15:43.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6642024-12-20T22:15:43.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6652024-12-20T22:15:43.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6662024-12-20T22:15:43.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6672024-12-20T22:15:43.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6682024-12-20T22:15:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6692024-12-20T22:15:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6702024-12-20T22:15:43.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6712024-12-20T22:15:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6722024-12-20T22:15:43.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6732024-12-20T22:15:43.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6742024-12-20T22:15:43.447ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 970, tv_nsec: 382321737 } })
6752024-12-20T22:15:43.447ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 970, tv_nsec: 382332077 } })
6762024-12-20T22:15:43.447ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
6772024-12-20T22:15:43.447ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
6782024-12-20T22:15:43.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6792024-12-20T22:15:43.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6802024-12-20T22:15:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6812024-12-20T22:15:43.449ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 13.872719ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6822024-12-20T22:15:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6832024-12-20T22:15:43.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6842024-12-20T22:15:43.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6852024-12-20T22:15:43.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6862024-12-20T22:15:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6872024-12-20T22:15:43.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6882024-12-20T22:15:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6892024-12-20T22:15:43.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6902024-12-20T22:15:43.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6912024-12-20T22:15:43.467ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6922024-12-20T22:15:43.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6932024-12-20T22:15:43.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6942024-12-20T22:15:43.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6952024-12-20T22:15:43.478ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 970, tv_nsec: 413554052 } })
6962024-12-20T22:15:43.479ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
6972024-12-20T22:15:43.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6982024-12-20T22:15:43.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6992024-12-20T22:15:43.496ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7002024-12-20T22:15:43.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7012024-12-20T22:15:43.499ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7022024-12-20T22:15:43.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7032024-12-20T22:15:43.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.728291ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
7042024-12-20T22:15:43.507ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.156556ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
7052024-12-20T22:15:43.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7062024-12-20T22:15:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7072024-12-20T22:15:43.513ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7082024-12-20T22:15:43.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7092024-12-20T22:15:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7102024-12-20T22:15:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
7112024-12-20T22:15:43.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7122024-12-20T22:15:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7132024-12-20T22:15:43.518ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.503821ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7142024-12-20T22:15:43.520ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7152024-12-20T22:15:43.520ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7162024-12-20T22:15:43.520ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d02cb91-6fa9-4be4-ac74-9498abb538fc", "content-length": "26", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
7172024-12-20T22:15:43.520ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7182024-12-20T22:15:43.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7192024-12-20T22:15:43.522ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7202024-12-20T22:15:43.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7212024-12-20T22:15:43.525ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7222024-12-20T22:15:43.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7232024-12-20T22:15:43.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7242024-12-20T22:15:43.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7252024-12-20T22:15:43.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7262024-12-20T22:15:43.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7272024-12-20T22:15:43.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
7282024-12-20T22:15:43.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.127728ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
7292024-12-20T22:15:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.634864ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7302024-12-20T22:15:43.544ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7312024-12-20T22:15:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7322024-12-20T22:15:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 109.478101ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7332024-12-20T22:15:43.561ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7342024-12-20T22:15:43.561ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7352024-12-20T22:15:43.561ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bf94c0b-910e-4bad-877e-acf0929f0de7", "content-length": "26", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
7362024-12-20T22:15:43.561ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7372024-12-20T22:15:43.563ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7382024-12-20T22:15:43.567ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7392024-12-20T22:15:43.567ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 131.698426ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7402024-12-20T22:15:43.579ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
7412024-12-20T22:15:43.579ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7422024-12-20T22:15:43.579ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "097b75a1-dec9-4171-a4c4-979c8bff246a", "content-length": "26", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
7432024-12-20T22:15:43.579ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7442024-12-20T22:15:43.581ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
7452024-12-20T22:15:43.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 155.600866ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7462024-12-20T22:15:43.593ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7472024-12-20T22:15:43.593ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7482024-12-20T22:15:43.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7492024-12-20T22:15:43.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7502024-12-20T22:15:43.595ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7512024-12-20T22:15:43.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7522024-12-20T22:15:43.639ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7532024-12-20T22:15:43.639ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7542024-12-20T22:15:43.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7552024-12-20T22:15:43.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7562024-12-20T22:15:43.658ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7572024-12-20T22:15:43.658ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ffdd070-4993-42fa-9472-83c8e271ce6d", "content-length": "1", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
7582024-12-20T22:15:43.660ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7592024-12-20T22:15:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7602024-12-20T22:15:43.664ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 229.342248ms iteration = 7 status = {"physical_disks_added":0}
7612024-12-20T22:15:43.669ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 233.53102ms iteration = 4 status = {}
7622024-12-20T22:15:43.671ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7632024-12-20T22:15:43.671ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7642024-12-20T22:15:43.671ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 236.39727ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7652024-12-20T22:15:43.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7662024-12-20T22:15:43.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7672024-12-20T22:15:43.713ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7682024-12-20T22:15:43.713ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7692024-12-20T22:15:43.714ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9677b17e-54ca-42c4-81f0-9de18f1fe91a", "content-length": "372", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
7702024-12-20T22:15:43.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7712024-12-20T22:15:43.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7722024-12-20T22:15:43.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7732024-12-20T22:15:43.717ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 282.055409ms iteration = 4 status = null
7742024-12-20T22:15:43.719ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7752024-12-20T22:15:43.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7762024-12-20T22:15:43.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7772024-12-20T22:15:43.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7782024-12-20T22:15:43.723ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7792024-12-20T22:15:43.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7802024-12-20T22:15:43.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7812024-12-20T22:15:43.730ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7822024-12-20T22:15:43.730ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7832024-12-20T22:15:43.731ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ef0361a0-d07b-44db-8784-f6d4fa7aa338", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
7842024-12-20T22:15:43.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7852024-12-20T22:15:43.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7862024-12-20T22:15:43.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7872024-12-20T22:15:43.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7882024-12-20T22:15:43.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7892024-12-20T22:15:43.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7902024-12-20T22:15:43.753ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7912024-12-20T22:15:43.753ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7922024-12-20T22:15:43.753ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c8c1b5a5-4bd2-4b69-805b-7d471b4ee2a8", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
7932024-12-20T22:15:43.755ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 319.776089ms iteration = 5 status = {}
7942024-12-20T22:15:43.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7952024-12-20T22:15:43.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7962024-12-20T22:15:43.783ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
7972024-12-20T22:15:43.783ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7982024-12-20T22:15:43.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7992024-12-20T22:15:43.850ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8002024-12-20T22:15:43.851ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7396fa88-06a7-469e-a666-e3be940f4074", "content-length": "691", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
8012024-12-20T22:15:43.851ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8022024-12-20T22:15:43.851ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8032024-12-20T22:15:43.851ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8042024-12-20T22:15:43.852ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 417.25891ms iteration = 4 status = {}
8052024-12-20T22:15:43.902ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8062024-12-20T22:15:43.902ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8b08f9b-9563-43b0-a560-e7a4ba557e70", "content-length": "134", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
8072024-12-20T22:15:43.902ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8082024-12-20T22:15:43.902ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
8092024-12-20T22:15:43.903ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8102024-12-20T22:15:43.903ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8112024-12-20T22:15:43.903ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8122024-12-20T22:15:43.903ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8132024-12-20T22:15:43.903ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8142024-12-20T22:15:43.903ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8152024-12-20T22:15:43.903ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8162024-12-20T22:15:43.903ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8172024-12-20T22:15:43.903ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
8182024-12-20T22:15:43.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8192024-12-20T22:15:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8202024-12-20T22:15:43.906ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8212024-12-20T22:15:43.906ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "99b1f817-0864-4e61-a7c2-99d8c62a0491", "content-length": "2", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
8222024-12-20T22:15:43.906ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8232024-12-20T22:15:43.906ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc256f53-58c9-4a54-baf8-0c0d42edfc5f", "content-length": "52", "date": "Fri, 20 Dec 2024 22:15:43 GMT"} })
8242024-12-20T22:15:43.906ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
8252024-12-20T22:15:43.906ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8262024-12-20T22:15:43.972ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8272024-12-20T22:15:43.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8282024-12-20T22:15:43.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8292024-12-20T22:15:43.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8302024-12-20T22:15:43.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8312024-12-20T22:15:43.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
8322024-12-20T22:15:43.980ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8332024-12-20T22:15:43.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8342024-12-20T22:15:43.982ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 546.932744ms iteration = 4 status = 0
8352024-12-20T22:15:44.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a1a65f7a-4559-424b-8792-8efb28d07f16 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8362024-12-20T22:15:44.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a1a65f7a-4559-424b-8792-8efb28d07f16 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8372024-12-20T22:15:44.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a1a65f7a-4559-424b-8792-8efb28d07f16 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8382024-12-20T22:15:44.107ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a21370d9-c667-426b-9904-767adbc3634b", "date": "Fri, 20 Dec 2024 22:15:44 GMT"} })
8392024-12-20T22:15:44.107ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
8402024-12-20T22:15:44.107ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8412024-12-20T22:15:44.111ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0811680f-d76d-4cb8-a5dc-f1edd7ba1abe", "content-length": "682", "date": "Fri, 20 Dec 2024 22:15:44 GMT"} })
8422024-12-20T22:15:44.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8432024-12-20T22:15:44.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8442024-12-20T22:15:44.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8452024-12-20T22:15:44.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8462024-12-20T22:15:44.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8472024-12-20T22:15:44.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8482024-12-20T22:15:44.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8492024-12-20T22:15:44.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8502024-12-20T22:15:44.135ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 699.466069ms iteration = 4 status = {}
8512024-12-20T22:15:44.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 15c3a2b2-17ec-445d-91ca-52d8c9ca9199 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8522024-12-20T22:15:44.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 15c3a2b2-17ec-445d-91ca-52d8c9ca9199 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8532024-12-20T22:15:44.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 15c3a2b2-17ec-445d-91ca-52d8c9ca9199 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8542024-12-20T22:15:45.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 769dee91-97ad-4fc9-aa99-c5bf4d31b161 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8552024-12-20T22:15:45.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 769dee91-97ad-4fc9-aa99-c5bf4d31b161 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8562024-12-20T22:15:45.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 769dee91-97ad-4fc9-aa99-c5bf4d31b161 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8572024-12-20T22:15:45.681ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1324 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = c927b578-5085-497a-80bc-7d8cfccd2a2e response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
8582024-12-20T22:15:46.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 89bddc17-fc4c-4779-b1f1-d8953900c1ac roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8592024-12-20T22:15:46.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 89bddc17-fc4c-4779-b1f1-d8953900c1ac resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8602024-12-20T22:15:46.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 89bddc17-fc4c-4779-b1f1-d8953900c1ac response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8612024-12-20T22:15:47.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8cce3e22-2223-40eb-b189-807d6f3a4003 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8622024-12-20T22:15:47.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8cce3e22-2223-40eb-b189-807d6f3a4003 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8632024-12-20T22:15:47.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8cce3e22-2223-40eb-b189-807d6f3a4003 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8642024-12-20T22:15:48.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63895466-8705-43c9-8db0-e19ea6f5d7f5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8652024-12-20T22:15:48.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63895466-8705-43c9-8db0-e19ea6f5d7f5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8662024-12-20T22:15:48.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63895466-8705-43c9-8db0-e19ea6f5d7f5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8672024-12-20T22:15:49.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c07544a6-9ee6-4290-896a-75d7e7fe1f6b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8682024-12-20T22:15:49.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c07544a6-9ee6-4290-896a-75d7e7fe1f6b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8692024-12-20T22:15:49.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c07544a6-9ee6-4290-896a-75d7e7fe1f6b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8702024-12-20T22:15:50.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = afcdbaa9-ca20-4b57-aebb-70b9362cb7a0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8712024-12-20T22:15:50.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = afcdbaa9-ca20-4b57-aebb-70b9362cb7a0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8722024-12-20T22:15:50.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = afcdbaa9-ca20-4b57-aebb-70b9362cb7a0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8732024-12-20T22:15:51.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = be42e7ee-8794-47b6-aeb8-13b03134fcbd roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8742024-12-20T22:15:51.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = be42e7ee-8794-47b6-aeb8-13b03134fcbd resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8752024-12-20T22:15:51.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = be42e7ee-8794-47b6-aeb8-13b03134fcbd response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8762024-12-20T22:15:52.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ae550692-0404-43f5-9055-9fcbfd5a894b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8772024-12-20T22:15:52.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ae550692-0404-43f5-9055-9fcbfd5a894b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8782024-12-20T22:15:52.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ae550692-0404-43f5-9055-9fcbfd5a894b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8792024-12-20T22:15:53.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0451e61f-c75f-4ddc-870e-781bc48eb466 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8802024-12-20T22:15:53.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0451e61f-c75f-4ddc-870e-781bc48eb466 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8812024-12-20T22:15:53.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0451e61f-c75f-4ddc-870e-781bc48eb466 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
8822024-12-20T22:15:53.435ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
8832024-12-20T22:15:53.435ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
8842024-12-20T22:15:53.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8852024-12-20T22:15:53.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8862024-12-20T22:15:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8872024-12-20T22:15:53.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8882024-12-20T22:15:53.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8892024-12-20T22:15:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8902024-12-20T22:15:53.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8912024-12-20T22:15:53.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8922024-12-20T22:15:53.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8932024-12-20T22:15:53.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8942024-12-20T22:15:53.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8952024-12-20T22:15:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
8962024-12-20T22:15:53.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8972024-12-20T22:15:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8982024-12-20T22:15:53.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8992024-12-20T22:15:53.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9002024-12-20T22:15:53.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.757661ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9012024-12-20T22:15:53.664ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
9022024-12-20T22:15:53.664ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 229.111505ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
9032024-12-20T22:15:54.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23e56ff0-85b1-45e3-b87c-cc3260d87624 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9042024-12-20T22:15:54.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23e56ff0-85b1-45e3-b87c-cc3260d87624 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9052024-12-20T22:15:54.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23e56ff0-85b1-45e3-b87c-cc3260d87624 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9062024-12-20T22:15:55.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8707ac82-6537-439c-93bd-ce92b2a97c14 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9072024-12-20T22:15:55.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8707ac82-6537-439c-93bd-ce92b2a97c14 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9082024-12-20T22:15:55.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8707ac82-6537-439c-93bd-ce92b2a97c14 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9092024-12-20T22:15:55.681ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1486 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = ca5db5c3-9c39-4bd9-9b14-541ffa5e90b6 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
9102024-12-20T22:15:56.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ab2762df-95eb-4c88-beba-fec1a2ea0146 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9112024-12-20T22:15:56.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ab2762df-95eb-4c88-beba-fec1a2ea0146 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9122024-12-20T22:15:56.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ab2762df-95eb-4c88-beba-fec1a2ea0146 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9132024-12-20T22:15:57.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2f9f96e3-d961-42fc-b5ac-47b3f657ebab roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9142024-12-20T22:15:57.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2f9f96e3-d961-42fc-b5ac-47b3f657ebab resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9152024-12-20T22:15:57.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2f9f96e3-d961-42fc-b5ac-47b3f657ebab response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9162024-12-20T22:15:58.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9a7466be-1e7a-4830-8148-a271b858dce5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9172024-12-20T22:15:58.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9a7466be-1e7a-4830-8148-a271b858dce5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9182024-12-20T22:15:58.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9a7466be-1e7a-4830-8148-a271b858dce5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9192024-12-20T22:15:59.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8e26ea70-a617-44b3-a229-416cf1a42d6d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9202024-12-20T22:15:59.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8e26ea70-a617-44b3-a229-416cf1a42d6d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9212024-12-20T22:15:59.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8e26ea70-a617-44b3-a229-416cf1a42d6d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9222024-12-20T22:16:00.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa6efc7c-b44e-4ad9-aaf5-746ed9db63de roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9232024-12-20T22:16:00.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa6efc7c-b44e-4ad9-aaf5-746ed9db63de resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9242024-12-20T22:16:00.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa6efc7c-b44e-4ad9-aaf5-746ed9db63de response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9252024-12-20T22:16:01.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7346fb40-3491-4b63-a696-be54bf76cbe5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9262024-12-20T22:16:01.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7346fb40-3491-4b63-a696-be54bf76cbe5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9272024-12-20T22:16:01.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7346fb40-3491-4b63-a696-be54bf76cbe5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9282024-12-20T22:16:02.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = acb46415-8129-4125-8ab1-693e353bb7a7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9292024-12-20T22:16:02.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = acb46415-8129-4125-8ab1-693e353bb7a7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9302024-12-20T22:16:02.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = acb46415-8129-4125-8ab1-693e353bb7a7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9312024-12-20T22:16:03.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
9322024-12-20T22:16:03.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
9332024-12-20T22:16:03.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9342024-12-20T22:16:03.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9352024-12-20T22:16:03.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9362024-12-20T22:16:03.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9372024-12-20T22:16:03.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9382024-12-20T22:16:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9392024-12-20T22:16:03.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9402024-12-20T22:16:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9412024-12-20T22:16:03.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9422024-12-20T22:16:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9432024-12-20T22:16:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9442024-12-20T22:16:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
9452024-12-20T22:16:03.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9462024-12-20T22:16:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9472024-12-20T22:16:03.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
9482024-12-20T22:16:03.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.308984ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
9492024-12-20T22:16:03.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4197d447-226d-4567-94a5-5defdf4027da roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9502024-12-20T22:16:03.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4197d447-226d-4567-94a5-5defdf4027da resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9512024-12-20T22:16:03.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4197d447-226d-4567-94a5-5defdf4027da response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9522024-12-20T22:16:03.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9532024-12-20T22:16:03.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9542024-12-20T22:16:03.503ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.60372ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9552024-12-20T22:16:04.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cff19f17-97a7-4f9e-bc8a-692b956075b6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9562024-12-20T22:16:04.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cff19f17-97a7-4f9e-bc8a-692b956075b6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9572024-12-20T22:16:04.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cff19f17-97a7-4f9e-bc8a-692b956075b6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9582024-12-20T22:16:05.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 83894051-3374-41bb-a00c-245bb8e6f6a0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9592024-12-20T22:16:05.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 83894051-3374-41bb-a00c-245bb8e6f6a0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9602024-12-20T22:16:05.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 83894051-3374-41bb-a00c-245bb8e6f6a0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9612024-12-20T22:16:05.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1278 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = c195f8e5-35a4-4153-84c2-44c6967bee00 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
9622024-12-20T22:16:06.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d4e1339e-157e-44f6-b63c-85d0b2af5341 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9632024-12-20T22:16:06.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d4e1339e-157e-44f6-b63c-85d0b2af5341 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9642024-12-20T22:16:06.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d4e1339e-157e-44f6-b63c-85d0b2af5341 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9652024-12-20T22:16:07.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ceaa4a47-0c8f-40ef-bcd5-cad954b035e7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9662024-12-20T22:16:07.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ceaa4a47-0c8f-40ef-bcd5-cad954b035e7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9672024-12-20T22:16:07.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ceaa4a47-0c8f-40ef-bcd5-cad954b035e7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9682024-12-20T22:16:08.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8dc1450b-13d3-4c75-9408-da70d6de35e9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9692024-12-20T22:16:08.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8dc1450b-13d3-4c75-9408-da70d6de35e9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9702024-12-20T22:16:08.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8dc1450b-13d3-4c75-9408-da70d6de35e9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9712024-12-20T22:16:09.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f4bf9173-4c85-4068-8d0c-7bc0945dc6b9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9722024-12-20T22:16:09.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f4bf9173-4c85-4068-8d0c-7bc0945dc6b9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9732024-12-20T22:16:09.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f4bf9173-4c85-4068-8d0c-7bc0945dc6b9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9742024-12-20T22:16:10.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0ae5fe7b-5a24-4235-ade4-f9057eb80900 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9752024-12-20T22:16:10.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0ae5fe7b-5a24-4235-ade4-f9057eb80900 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9762024-12-20T22:16:10.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0ae5fe7b-5a24-4235-ade4-f9057eb80900 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9772024-12-20T22:16:11.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e4b1cff1-2337-4ea9-a25b-b7afd9621339 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9782024-12-20T22:16:11.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e4b1cff1-2337-4ea9-a25b-b7afd9621339 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9792024-12-20T22:16:11.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e4b1cff1-2337-4ea9-a25b-b7afd9621339 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9802024-12-20T22:16:12.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ebc49246-f254-4025-a131-831811bc2d64 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9812024-12-20T22:16:12.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ebc49246-f254-4025-a131-831811bc2d64 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9822024-12-20T22:16:12.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ebc49246-f254-4025-a131-831811bc2d64 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
9832024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
9842024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
9852024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9862024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
9872024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
9882024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9892024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9902024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
9912024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9922024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9932024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
9942024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
9952024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
9962024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9972024-12-20T22:16:13.439ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9982024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
9992024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10002024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10012024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10022024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
10032024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10042024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
10052024-12-20T22:16:13.439ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
10062024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.061\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
10072024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
10082024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
10092024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10102024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10112024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
10122024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
10132024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10142024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10152024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
10162024-12-20T22:16:13.439ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:06:13.439415834 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10172024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10182024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
10192024-12-20T22:16:13.439ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10202024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10212024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
10222024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10232024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
10242024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
10252024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10262024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
10272024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10282024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
10292024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10302024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
10312024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
10322024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10332024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
10342024-12-20T22:16:13.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10352024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
10362024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
10372024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10382024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10392024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
10402024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
10412024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10422024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
10432024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
10442024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10452024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10462024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10472024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10482024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10492024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10502024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10512024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10522024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10532024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10542024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10552024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10562024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10572024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10582024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10592024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10602024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10612024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10622024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10632024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10642024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10652024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10662024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10672024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10682024-12-20T22:16:13.440ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1000, tv_nsec: 371154335 } })
10692024-12-20T22:16:13.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10702024-12-20T22:16:13.440ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1000, tv_nsec: 371183915 } })
10712024-12-20T22:16:13.441ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
10722024-12-20T22:16:13.441ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.738157ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
10732024-12-20T22:16:13.441ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
10742024-12-20T22:16:13.441ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.586966ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
10752024-12-20T22:16:13.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10762024-12-20T22:16:13.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1000, tv_nsec: 375064795 } })
10772024-12-20T22:16:13.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1000, tv_nsec: 375095845 } })
10782024-12-20T22:16:13.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10792024-12-20T22:16:13.444ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.97605ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10802024-12-20T22:16:13.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
10812024-12-20T22:16:13.445ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10822024-12-20T22:16:13.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10832024-12-20T22:16:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10842024-12-20T22:16:13.445ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
10852024-12-20T22:16:13.446ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10862024-12-20T22:16:13.446ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10872024-12-20T22:16:13.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10882024-12-20T22:16:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10892024-12-20T22:16:13.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10902024-12-20T22:16:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10912024-12-20T22:16:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10922024-12-20T22:16:13.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10932024-12-20T22:16:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10942024-12-20T22:16:13.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10952024-12-20T22:16:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10962024-12-20T22:16:13.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10972024-12-20T22:16:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10982024-12-20T22:16:13.451ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10992024-12-20T22:16:13.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11002024-12-20T22:16:13.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11012024-12-20T22:16:13.454ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11022024-12-20T22:16:13.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11032024-12-20T22:16:13.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11042024-12-20T22:16:13.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11052024-12-20T22:16:13.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11062024-12-20T22:16:13.456ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.087282ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
11072024-12-20T22:16:13.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11082024-12-20T22:16:13.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.769778ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
11092024-12-20T22:16:13.458ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:06:13.439415834 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11102024-12-20T22:16:13.458ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.093512ms iteration = 3 status = {"expiration":"2024-12-20T22:06:13.439415834Z","pruned":[]}
11112024-12-20T22:16:13.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11122024-12-20T22:16:13.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11132024-12-20T22:16:13.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11142024-12-20T22:16:13.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11152024-12-20T22:16:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11162024-12-20T22:16:13.462ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11172024-12-20T22:16:13.462ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11182024-12-20T22:16:13.462ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 23.223474ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11192024-12-20T22:16:13.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11202024-12-20T22:16:13.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11212024-12-20T22:16:13.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11222024-12-20T22:16:13.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11232024-12-20T22:16:13.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11242024-12-20T22:16:13.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11252024-12-20T22:16:13.478ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11262024-12-20T22:16:13.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11272024-12-20T22:16:13.481ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11282024-12-20T22:16:13.482ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11292024-12-20T22:16:13.482ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11302024-12-20T22:16:13.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11312024-12-20T22:16:13.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11322024-12-20T22:16:13.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11332024-12-20T22:16:13.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11342024-12-20T22:16:13.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11352024-12-20T22:16:13.484ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11362024-12-20T22:16:13.484ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 44.956482ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11372024-12-20T22:16:13.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11382024-12-20T22:16:13.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11392024-12-20T22:16:13.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11402024-12-20T22:16:13.489ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1000, tv_nsec: 419581192 } })
11412024-12-20T22:16:13.489ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
11422024-12-20T22:16:13.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11432024-12-20T22:16:13.490ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11442024-12-20T22:16:13.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11452024-12-20T22:16:13.514ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11462024-12-20T22:16:13.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11472024-12-20T22:16:13.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.182707ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11482024-12-20T22:16:13.517ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11492024-12-20T22:16:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11502024-12-20T22:16:13.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11512024-12-20T22:16:13.535ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11522024-12-20T22:16:13.535ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11532024-12-20T22:16:13.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11542024-12-20T22:16:13.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11552024-12-20T22:16:13.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11562024-12-20T22:16:13.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11572024-12-20T22:16:13.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11582024-12-20T22:16:13.542ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11592024-12-20T22:16:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11602024-12-20T22:16:13.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11612024-12-20T22:16:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11622024-12-20T22:16:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 104.241329ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
11632024-12-20T22:16:13.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11642024-12-20T22:16:13.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652024-12-20T22:16:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.665353ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11662024-12-20T22:16:13.545ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11672024-12-20T22:16:13.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11682024-12-20T22:16:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11692024-12-20T22:16:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
11702024-12-20T22:16:13.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11712024-12-20T22:16:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11722024-12-20T22:16:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
11732024-12-20T22:16:13.549ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11742024-12-20T22:16:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11752024-12-20T22:16:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11762024-12-20T22:16:13.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11772024-12-20T22:16:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11782024-12-20T22:16:13.552ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
11792024-12-20T22:16:13.552ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
11802024-12-20T22:16:13.552ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 113.144629ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
11812024-12-20T22:16:13.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11822024-12-20T22:16:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
11832024-12-20T22:16:13.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11842024-12-20T22:16:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11852024-12-20T22:16:13.558ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.24142ms iteration = 5 status = 0
11862024-12-20T22:16:13.560ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
11872024-12-20T22:16:13.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.182999ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
11882024-12-20T22:16:13.571ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11892024-12-20T22:16:13.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11902024-12-20T22:16:13.580ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11912024-12-20T22:16:13.580ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11922024-12-20T22:16:13.580ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4986535a-8dfd-4bf9-9a71-7b4071d87716", "content-length": "26", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} })
11932024-12-20T22:16:13.580ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11942024-12-20T22:16:13.582ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11952024-12-20T22:16:13.587ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11962024-12-20T22:16:13.587ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11972024-12-20T22:16:13.587ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb64babc-8d07-4843-9ced-d74eb635a947", "content-length": "26", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} })
11982024-12-20T22:16:13.587ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11992024-12-20T22:16:13.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12002024-12-20T22:16:13.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12012024-12-20T22:16:13.589ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12022024-12-20T22:16:13.590ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12032024-12-20T22:16:13.592ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12042024-12-20T22:16:13.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12052024-12-20T22:16:13.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12062024-12-20T22:16:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12072024-12-20T22:16:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12082024-12-20T22:16:13.593ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
12092024-12-20T22:16:13.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12102024-12-20T22:16:13.605ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12112024-12-20T22:16:13.605ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12122024-12-20T22:16:13.605ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 166.135342ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12132024-12-20T22:16:13.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12142024-12-20T22:16:13.607ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12152024-12-20T22:16:13.607ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12162024-12-20T22:16:13.607ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12172024-12-20T22:16:13.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12182024-12-20T22:16:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12192024-12-20T22:16:13.608ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12202024-12-20T22:16:13.608ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12212024-12-20T22:16:13.608ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12222024-12-20T22:16:13.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12232024-12-20T22:16:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12242024-12-20T22:16:13.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12252024-12-20T22:16:13.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12262024-12-20T22:16:13.644ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 204.825751ms iteration = 8 status = {"physical_disks_added":0}
12272024-12-20T22:16:13.648ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
12282024-12-20T22:16:13.648ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 208.998594ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
12292024-12-20T22:16:13.676ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
12302024-12-20T22:16:13.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1dd493cf-f383-48d5-8c4b-112196c8e567 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
12312024-12-20T22:16:13.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1dd493cf-f383-48d5-8c4b-112196c8e567 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
12322024-12-20T22:16:13.762ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
12332024-12-20T22:16:13.762ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12342024-12-20T22:16:13.762ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b0eb035-caf8-4d52-92f4-8765c7574ff1", "content-length": "26", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} })
12352024-12-20T22:16:13.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12362024-12-20T22:16:13.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
12372024-12-20T22:16:13.800ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12382024-12-20T22:16:13.800ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12392024-12-20T22:16:13.800ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7402a4a7-2dfe-4d6a-9f0d-f6469069a6fa", "content-length": "372", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} })
12402024-12-20T22:16:13.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12412024-12-20T22:16:13.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12422024-12-20T22:16:13.806ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12432024-12-20T22:16:13.806ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "62ff601b-5976-4f03-be69-33125d2db2dd", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12442024-12-20T22:16:13.806ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12452024-12-20T22:16:13.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12462024-12-20T22:16:13.813ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "29a027ef-5594-4c5e-b492-1760a8e61795", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12472024-12-20T22:16:13.813ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12482024-12-20T22:16:13.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12492024-12-20T22:16:13.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12502024-12-20T22:16:13.815ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12512024-12-20T22:16:13.815ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 376.211406ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
12522024-12-20T22:16:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12532024-12-20T22:16:13.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1dd493cf-f383-48d5-8c4b-112196c8e567 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
12542024-12-20T22:16:13.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12552024-12-20T22:16:13.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12562024-12-20T22:16:13.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12572024-12-20T22:16:13.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12582024-12-20T22:16:13.852ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
12592024-12-20T22:16:13.852ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 412.36596ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
12602024-12-20T22:16:13.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 412.991937ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12612024-12-20T22:16:13.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 415.068867ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
12622024-12-20T22:16:13.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12632024-12-20T22:16:13.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12642024-12-20T22:16:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12652024-12-20T22:16:13.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12662024-12-20T22:16:13.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12672024-12-20T22:16:13.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12682024-12-20T22:16:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12692024-12-20T22:16:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12702024-12-20T22:16:13.862ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12712024-12-20T22:16:13.862ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12722024-12-20T22:16:13.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12732024-12-20T22:16:13.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12742024-12-20T22:16:13.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12752024-12-20T22:16:13.863ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12762024-12-20T22:16:13.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12772024-12-20T22:16:13.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12782024-12-20T22:16:13.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12792024-12-20T22:16:13.880ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12802024-12-20T22:16:13.880ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f2f84c1-b236-4af4-9788-57f643c76dc0", "content-length": "1", "date": "Fri, 20 Dec 2024 22:16:12 GMT"} })
12812024-12-20T22:16:13.883ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12822024-12-20T22:16:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12832024-12-20T22:16:13.887ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 448.316642ms iteration = 5 status = {}
12842024-12-20T22:16:13.893ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
12852024-12-20T22:16:13.893ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
12862024-12-20T22:16:13.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12872024-12-20T22:16:13.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12882024-12-20T22:16:13.928ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
12892024-12-20T22:16:13.928ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12902024-12-20T22:16:13.928ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "01c7e124-7de3-4a78-ad69-a53c112e9b6e", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} })
12912024-12-20T22:16:13.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12922024-12-20T22:16:13.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12932024-12-20T22:16:13.948ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12942024-12-20T22:16:13.949ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "27e26e12-7e68-4a65-8ed0-f84039442309", "content-length": "691", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} })
12952024-12-20T22:16:13.949ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12962024-12-20T22:16:13.949ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12972024-12-20T22:16:13.949ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12982024-12-20T22:16:13.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12992024-12-20T22:16:13.951ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 511.931832ms iteration = 5 status = null
13002024-12-20T22:16:13.951ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 512.69615ms iteration = 5 status = {}
13012024-12-20T22:16:13.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13022024-12-20T22:16:13.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13032024-12-20T22:16:13.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13042024-12-20T22:16:13.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13052024-12-20T22:16:13.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13062024-12-20T22:16:13.955ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
13072024-12-20T22:16:13.955ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13082024-12-20T22:16:13.955ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
13092024-12-20T22:16:13.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 516.309136ms iteration = 4 status = {"generation":2}
13102024-12-20T22:16:13.957ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13112024-12-20T22:16:13.957ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "39ba17cb-0e7d-402f-9c5f-43f68fe8a45d", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13122024-12-20T22:16:13.957ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13132024-12-20T22:16:13.958ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "30281619-3fa8-4cfc-9400-44cb27de08b4", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13142024-12-20T22:16:13.958ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13152024-12-20T22:16:13.960ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "22bcd50f-7946-4c7a-b34d-c2ca15169eb2", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13162024-12-20T22:16:13.960ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13172024-12-20T22:16:13.961ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13182024-12-20T22:16:13.961ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 522.62193ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13192024-12-20T22:16:13.975ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13202024-12-20T22:16:13.975ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13212024-12-20T22:16:13.975ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
13222024-12-20T22:16:13.975ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 536.525489ms iteration = 4 status = {"generation":1}
13232024-12-20T22:16:13.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13242024-12-20T22:16:13.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13252024-12-20T22:16:13.996ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
13262024-12-20T22:16:13.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13272024-12-20T22:16:13.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13282024-12-20T22:16:14.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13292024-12-20T22:16:14.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13302024-12-20T22:16:14.055ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13312024-12-20T22:16:14.055ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbf89b66-4ab6-4906-bc09-0ca5b8f53d8e", "content-length": "134", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} })
13322024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13332024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
13342024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13352024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13362024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13372024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13382024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13392024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13402024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13412024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13422024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13432024-12-20T22:16:14.056ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13442024-12-20T22:16:14.056ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
13452024-12-20T22:16:14.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13462024-12-20T22:16:14.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13472024-12-20T22:16:14.057ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b7079f72-884f-4d23-8b33-0207ea78093e", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} })
13482024-12-20T22:16:14.059ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 619.761547ms iteration = 6 status = {}
13492024-12-20T22:16:14.059ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13502024-12-20T22:16:14.059ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7d7c1df-b9db-4e51-a5c5-cfed8d43ea1e", "content-length": "2", "date": "Fri, 20 Dec 2024 22:16:14 GMT"} })
13512024-12-20T22:16:14.059ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13522024-12-20T22:16:14.059ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "faf5fe79-a07b-4436-ad82-f732a09eef96", "content-length": "52", "date": "Fri, 20 Dec 2024 22:16:14 GMT"} })
13532024-12-20T22:16:14.059ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
13542024-12-20T22:16:14.059ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13552024-12-20T22:16:14.154ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "abff2ecc-ca20-4f22-b582-bb4b816b0dcf", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} })
13562024-12-20T22:16:14.154ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
13572024-12-20T22:16:14.154ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13582024-12-20T22:16:14.246ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffcd82ce-081c-4944-be42-70cd4ab84fe2", "content-length": "682", "date": "Fri, 20 Dec 2024 22:16:13 GMT"} })
13592024-12-20T22:16:14.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13602024-12-20T22:16:14.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13612024-12-20T22:16:14.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13622024-12-20T22:16:14.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13632024-12-20T22:16:14.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13642024-12-20T22:16:14.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13652024-12-20T22:16:14.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13662024-12-20T22:16:14.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13672024-12-20T22:16:14.262ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 823.048183ms iteration = 5 status = {}
13682024-12-20T22:16:14.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 82dfb9f5-2987-443a-8efa-f5e46d53bdb1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13692024-12-20T22:16:14.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 82dfb9f5-2987-443a-8efa-f5e46d53bdb1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
13702024-12-20T22:16:14.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3695 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 82dfb9f5-2987-443a-8efa-f5e46d53bdb1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
13712024-12-20T22:16:14.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b44e8b47-592b-43be-854b-d3d6fe341cdb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13722024-12-20T22:16:14.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b44e8b47-592b-43be-854b-d3d6fe341cdb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13732024-12-20T22:16:14.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b44e8b47-592b-43be-854b-d3d6fe341cdb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13742024-12-20T22:16:15.685ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1321 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = d333f76a-dc93-4da1-a4f1-4291bbdd2a29 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
13752024-12-20T22:16:15.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6889c01e-7548-424e-a012-0b50d79a7c24 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13762024-12-20T22:16:15.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6889c01e-7548-424e-a012-0b50d79a7c24 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13772024-12-20T22:16:15.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6889c01e-7548-424e-a012-0b50d79a7c24 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13782024-12-20T22:16:16.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bc6cd718-3b59-4919-a2c1-502dd7b624f3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13792024-12-20T22:16:16.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bc6cd718-3b59-4919-a2c1-502dd7b624f3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13802024-12-20T22:16:16.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bc6cd718-3b59-4919-a2c1-502dd7b624f3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13812024-12-20T22:16:17.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 859a7cf1-6803-4ecd-a54e-3ae0a6999e1e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13822024-12-20T22:16:17.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 859a7cf1-6803-4ecd-a54e-3ae0a6999e1e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13832024-12-20T22:16:17.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 859a7cf1-6803-4ecd-a54e-3ae0a6999e1e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13842024-12-20T22:16:18.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f516cc2a-183f-4ab0-a839-d3ce13ed7286 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13852024-12-20T22:16:18.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f516cc2a-183f-4ab0-a839-d3ce13ed7286 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13862024-12-20T22:16:18.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f516cc2a-183f-4ab0-a839-d3ce13ed7286 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13872024-12-20T22:16:19.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 36c76d82-0124-4bac-bf54-354c09cdacef roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13882024-12-20T22:16:19.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 36c76d82-0124-4bac-bf54-354c09cdacef resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13892024-12-20T22:16:19.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 36c76d82-0124-4bac-bf54-354c09cdacef response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13902024-12-20T22:16:20.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fefe2c56-7f56-4d79-bdae-a994d52b9612 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13912024-12-20T22:16:20.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fefe2c56-7f56-4d79-bdae-a994d52b9612 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13922024-12-20T22:16:20.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fefe2c56-7f56-4d79-bdae-a994d52b9612 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13932024-12-20T22:16:21.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e84f648f-4a99-47a1-add1-51111454288c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13942024-12-20T22:16:21.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e84f648f-4a99-47a1-add1-51111454288c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13952024-12-20T22:16:21.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e84f648f-4a99-47a1-add1-51111454288c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13962024-12-20T22:16:23.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = caf73c93-b3e1-4f70-ad42-40e4a3dbe6fd roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13972024-12-20T22:16:23.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = caf73c93-b3e1-4f70-ad42-40e4a3dbe6fd resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13982024-12-20T22:16:23.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = caf73c93-b3e1-4f70-ad42-40e4a3dbe6fd response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
13992024-12-20T22:16:23.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
14002024-12-20T22:16:23.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
14012024-12-20T22:16:23.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14022024-12-20T22:16:23.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14032024-12-20T22:16:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14042024-12-20T22:16:23.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14052024-12-20T22:16:23.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14062024-12-20T22:16:23.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14072024-12-20T22:16:23.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14082024-12-20T22:16:23.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.618136ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14092024-12-20T22:16:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14102024-12-20T22:16:23.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14112024-12-20T22:16:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14122024-12-20T22:16:23.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14132024-12-20T22:16:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14142024-12-20T22:16:23.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14152024-12-20T22:16:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
14162024-12-20T22:16:23.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14172024-12-20T22:16:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14182024-12-20T22:16:23.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
14192024-12-20T22:16:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 122.347201ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
14202024-12-20T22:16:24.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf66a552-bec4-4b57-960f-88aa8cf6ba0c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14212024-12-20T22:16:24.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf66a552-bec4-4b57-960f-88aa8cf6ba0c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14222024-12-20T22:16:24.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf66a552-bec4-4b57-960f-88aa8cf6ba0c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14232024-12-20T22:16:25.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a850ea65-10e5-42b7-a83d-7706b64527c9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14242024-12-20T22:16:25.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a850ea65-10e5-42b7-a83d-7706b64527c9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14252024-12-20T22:16:25.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a850ea65-10e5-42b7-a83d-7706b64527c9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14262024-12-20T22:16:25.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1360 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 3aedd46f-0644-4187-9733-a63b18ee4198 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
14272024-12-20T22:16:26.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 164ab5a7-2358-4376-88cd-f022da95f1d2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14282024-12-20T22:16:26.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 164ab5a7-2358-4376-88cd-f022da95f1d2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14292024-12-20T22:16:26.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 164ab5a7-2358-4376-88cd-f022da95f1d2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14302024-12-20T22:16:27.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12eb2a14-693a-4fee-b0dc-5ba701382d35 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14312024-12-20T22:16:27.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12eb2a14-693a-4fee-b0dc-5ba701382d35 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14322024-12-20T22:16:27.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12eb2a14-693a-4fee-b0dc-5ba701382d35 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14332024-12-20T22:16:28.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = be31067d-597c-4d83-89e3-b71fbc7a1f84 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14342024-12-20T22:16:28.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = be31067d-597c-4d83-89e3-b71fbc7a1f84 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14352024-12-20T22:16:28.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = be31067d-597c-4d83-89e3-b71fbc7a1f84 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14362024-12-20T22:16:29.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dce62e07-1bee-4470-942c-c4dd0113d41d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14372024-12-20T22:16:29.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dce62e07-1bee-4470-942c-c4dd0113d41d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14382024-12-20T22:16:29.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dce62e07-1bee-4470-942c-c4dd0113d41d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14392024-12-20T22:16:30.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 08e4ebad-30bb-44a2-b0ab-bb528949f241 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14402024-12-20T22:16:30.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 08e4ebad-30bb-44a2-b0ab-bb528949f241 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14412024-12-20T22:16:30.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 08e4ebad-30bb-44a2-b0ab-bb528949f241 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14422024-12-20T22:16:31.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8e83c3a1-b85d-4350-b511-1dcd821278c5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14432024-12-20T22:16:31.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8e83c3a1-b85d-4350-b511-1dcd821278c5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14442024-12-20T22:16:31.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8e83c3a1-b85d-4350-b511-1dcd821278c5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14452024-12-20T22:16:32.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d88eec0-3280-4e78-9c2b-6cc58dd52308 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14462024-12-20T22:16:32.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d88eec0-3280-4e78-9c2b-6cc58dd52308 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14472024-12-20T22:16:32.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d88eec0-3280-4e78-9c2b-6cc58dd52308 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14482024-12-20T22:16:33.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8984f648-2c8c-4a24-9cdf-d9b5297cc1ca roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14492024-12-20T22:16:33.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8984f648-2c8c-4a24-9cdf-d9b5297cc1ca resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14502024-12-20T22:16:33.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8984f648-2c8c-4a24-9cdf-d9b5297cc1ca response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14512024-12-20T22:16:33.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
14522024-12-20T22:16:33.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
14532024-12-20T22:16:33.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14542024-12-20T22:16:33.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14552024-12-20T22:16:33.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14562024-12-20T22:16:33.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14572024-12-20T22:16:33.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14582024-12-20T22:16:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14592024-12-20T22:16:33.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14602024-12-20T22:16:33.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.718348ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14612024-12-20T22:16:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14622024-12-20T22:16:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14632024-12-20T22:16:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14642024-12-20T22:16:33.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14652024-12-20T22:16:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14662024-12-20T22:16:33.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14672024-12-20T22:16:33.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
14682024-12-20T22:16:33.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14692024-12-20T22:16:33.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14702024-12-20T22:16:33.566ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
14712024-12-20T22:16:33.566ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 126.299871ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
14722024-12-20T22:16:34.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0944b64b-556d-4e97-a670-a47d3219de51 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14732024-12-20T22:16:34.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0944b64b-556d-4e97-a670-a47d3219de51 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14742024-12-20T22:16:34.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0944b64b-556d-4e97-a670-a47d3219de51 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14752024-12-20T22:16:35.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a356c73f-1463-4038-8b82-85cc116c445d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14762024-12-20T22:16:35.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a356c73f-1463-4038-8b82-85cc116c445d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14772024-12-20T22:16:35.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a356c73f-1463-4038-8b82-85cc116c445d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14782024-12-20T22:16:35.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = d08748d3-24f9-4758-8a34-492e7753c60c response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
14792024-12-20T22:16:36.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2e8ac71e-7d8b-4bf7-b8c3-f8e81273e4bc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14802024-12-20T22:16:36.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2e8ac71e-7d8b-4bf7-b8c3-f8e81273e4bc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14812024-12-20T22:16:36.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2e8ac71e-7d8b-4bf7-b8c3-f8e81273e4bc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14822024-12-20T22:16:37.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b6517fb3-24ba-403b-aee3-5f9beabd1ce9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14832024-12-20T22:16:37.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b6517fb3-24ba-403b-aee3-5f9beabd1ce9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14842024-12-20T22:16:37.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b6517fb3-24ba-403b-aee3-5f9beabd1ce9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14852024-12-20T22:16:38.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3a44cf44-088c-4d03-87b2-11e166764f88 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14862024-12-20T22:16:38.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3a44cf44-088c-4d03-87b2-11e166764f88 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14872024-12-20T22:16:38.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3a44cf44-088c-4d03-87b2-11e166764f88 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14882024-12-20T22:16:39.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 069b90f3-329c-41ca-9ff8-305b1545420f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14892024-12-20T22:16:39.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 069b90f3-329c-41ca-9ff8-305b1545420f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14902024-12-20T22:16:39.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 069b90f3-329c-41ca-9ff8-305b1545420f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14912024-12-20T22:16:40.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4ba69634-8876-46b7-bbf6-0d95caeb103c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14922024-12-20T22:16:40.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4ba69634-8876-46b7-bbf6-0d95caeb103c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14932024-12-20T22:16:40.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4ba69634-8876-46b7-bbf6-0d95caeb103c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
14942024-12-20T22:16:40.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 4b47c4e4-055c-4b42-a434-d060487c2756 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
14952024-12-20T22:16:40.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 4b47c4e4-055c-4b42-a434-d060487c2756 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
14962024-12-20T22:16:40.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 4b47c4e4-055c-4b42-a434-d060487c2756 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
14972024-12-20T22:16:40.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 47f9740f-cbe5-497f-a8a8-2c4985d2dec4 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
14982024-12-20T22:16:40.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 47f9740f-cbe5-497f-a8a8-2c4985d2dec4 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
14992024-12-20T22:16:40.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 47f9740f-cbe5-497f-a8a8-2c4985d2dec4 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
15002024-12-20T22:16:41.070ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60489
15012024-12-20T22:16:41.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60489 req_id = 6b8a8c6d-a802-4f92-8c78-5e6bd745dc91 roles = RoleSet { roles: {} } uri = /metrics/producers
15022024-12-20T22:16:41.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60489 req_id = 6b8a8c6d-a802-4f92-8c78-5e6bd745dc91 resource = Database result = Ok(()) uri = /metrics/producers
15032024-12-20T22:16:41.210ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 409c06a2-2340-44a9-a04f-6817610bd642
15042024-12-20T22:16:41.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140275 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60489 req_id = 6b8a8c6d-a802-4f92-8c78-5e6bd745dc91 response_code = 201 uri = /metrics/producers
15052024-12-20T22:16:41.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cac535fa-3c77-461b-90fb-0c5adf455e8f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
15062024-12-20T22:16:41.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cac535fa-3c77-461b-90fb-0c5adf455e8f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
15072024-12-20T22:16:41.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cac535fa-3c77-461b-90fb-0c5adf455e8f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
15082024-12-20T22:16:42.046ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63515
15092024-12-20T22:16:42.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63515 req_id = 7fba5528-d609-4658-a9df-a048be1475f0 roles = RoleSet { roles: {} } uri = /metrics/producers
15102024-12-20T22:16:42.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63515 req_id = 7fba5528-d609-4658-a9df-a048be1475f0 resource = Database result = Ok(()) uri = /metrics/producers
15112024-12-20T22:16:42.195ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 1cf20796-1e8a-4632-b82f-1c78cae2c84a
15122024-12-20T22:16:42.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148659 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63515 req_id = 7fba5528-d609-4658-a9df-a048be1475f0 response_code = 201 uri = /metrics/producers
15132024-12-20T22:16:42.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8db4957-08cf-4203-953c-2dd934bbb570 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
15142024-12-20T22:16:42.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8db4957-08cf-4203-953c-2dd934bbb570 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
15152024-12-20T22:16:42.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8db4957-08cf-4203-953c-2dd934bbb570 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
15162024-12-20T22:16:43.345ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38758
15172024-12-20T22:16:43.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38758 req_id = 6302842e-a192-4ae7-8ee9-bf88c56f6467 roles = RoleSet { roles: {} } uri = /metrics/producers
15182024-12-20T22:16:43.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38758 req_id = 6302842e-a192-4ae7-8ee9-bf88c56f6467 resource = Database result = Ok(()) uri = /metrics/producers
15192024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
15202024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15212024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
15222024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15232024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15242024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
15252024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15262024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
15272024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
15282024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15292024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15302024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
15312024-12-20T22:16:43.440ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15322024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15332024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
15342024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
15352024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15362024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
15372024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15382024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
15392024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
15402024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15412024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15422024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
15432024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15442024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
15452024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15462024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
15472024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15482024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
15492024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15502024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
15512024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15522024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
15532024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15542024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15552024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15562024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15572024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15582024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15592024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15602024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15612024-12-20T22:16:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15622024-12-20T22:16:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15632024-12-20T22:16:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15642024-12-20T22:16:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15652024-12-20T22:16:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15662024-12-20T22:16:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15672024-12-20T22:16:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15682024-12-20T22:16:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15692024-12-20T22:16:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15702024-12-20T22:16:43.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712024-12-20T22:16:43.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15722024-12-20T22:16:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15732024-12-20T22:16:43.445ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15742024-12-20T22:16:43.445ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15752024-12-20T22:16:43.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15762024-12-20T22:16:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15772024-12-20T22:16:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15782024-12-20T22:16:43.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15792024-12-20T22:16:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15802024-12-20T22:16:43.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15812024-12-20T22:16:43.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15822024-12-20T22:16:43.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1030, tv_nsec: 380959154 } })
15832024-12-20T22:16:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15842024-12-20T22:16:43.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15852024-12-20T22:16:43.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
15862024-12-20T22:16:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15872024-12-20T22:16:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15882024-12-20T22:16:43.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15892024-12-20T22:16:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15902024-12-20T22:16:43.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f6ff8b78-a2d0-4e84-b8b9-cd25443ca379 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
15912024-12-20T22:16:43.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f6ff8b78-a2d0-4e84-b8b9-cd25443ca379 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
15922024-12-20T22:16:43.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15932024-12-20T22:16:43.454ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1030, tv_nsec: 383896393 } })
15942024-12-20T22:16:43.454ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
15952024-12-20T22:16:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15962024-12-20T22:16:43.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15972024-12-20T22:16:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15982024-12-20T22:16:43.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15992024-12-20T22:16:43.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16002024-12-20T22:16:43.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16012024-12-20T22:16:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16022024-12-20T22:16:43.459ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1030, tv_nsec: 389451919 } })
16032024-12-20T22:16:43.459ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
16042024-12-20T22:16:43.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16052024-12-20T22:16:43.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16062024-12-20T22:16:43.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f6ff8b78-a2d0-4e84-b8b9-cd25443ca379 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
16072024-12-20T22:16:43.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16082024-12-20T22:16:43.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
16092024-12-20T22:16:43.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16102024-12-20T22:16:43.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16112024-12-20T22:16:43.468ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16122024-12-20T22:16:43.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16132024-12-20T22:16:43.486ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16142024-12-20T22:16:43.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16152024-12-20T22:16:43.488ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.411257ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
16162024-12-20T22:16:43.495ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16172024-12-20T22:16:43.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16182024-12-20T22:16:43.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16192024-12-20T22:16:43.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16202024-12-20T22:16:43.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16212024-12-20T22:16:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16222024-12-20T22:16:43.510ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
16232024-12-20T22:16:43.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.114666ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
16242024-12-20T22:16:43.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16252024-12-20T22:16:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16262024-12-20T22:16:43.517ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16272024-12-20T22:16:43.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16282024-12-20T22:16:43.519ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.040885ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
16292024-12-20T22:16:43.519ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.627801ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16302024-12-20T22:16:43.521ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 99b0250f-bcf3-46ae-aea9-2bb2360d90eb
16312024-12-20T22:16:43.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175632 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38758 req_id = 6302842e-a192-4ae7-8ee9-bf88c56f6467 response_code = 201 uri = /metrics/producers
16322024-12-20T22:16:43.523ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16332024-12-20T22:16:43.523ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16342024-12-20T22:16:43.523ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16352024-12-20T22:16:43.523ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16362024-12-20T22:16:43.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16372024-12-20T22:16:43.525ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16382024-12-20T22:16:43.525ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.133357ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16392024-12-20T22:16:43.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16402024-12-20T22:16:43.525ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16412024-12-20T22:16:43.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16422024-12-20T22:16:43.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16432024-12-20T22:16:43.534ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16442024-12-20T22:16:43.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16452024-12-20T22:16:43.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16462024-12-20T22:16:43.536ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16472024-12-20T22:16:43.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16482024-12-20T22:16:43.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16492024-12-20T22:16:43.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16502024-12-20T22:16:43.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16512024-12-20T22:16:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16522024-12-20T22:16:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 104.541813ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16532024-12-20T22:16:43.552ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
16542024-12-20T22:16:43.552ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16552024-12-20T22:16:43.553ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b7f96e3-628d-4721-881c-a4bfc333ed8c", "content-length": "26", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
16562024-12-20T22:16:43.553ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16572024-12-20T22:16:43.555ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
16582024-12-20T22:16:43.558ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16592024-12-20T22:16:43.559ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16602024-12-20T22:16:43.559ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02c250a2-d60c-4c57-8375-c50321b9ca30", "content-length": "26", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
16612024-12-20T22:16:43.559ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16622024-12-20T22:16:43.561ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16632024-12-20T22:16:43.561ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16642024-12-20T22:16:43.561ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16652024-12-20T22:16:43.561ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db0e09fa-b409-4336-9ee8-3c9297907274", "content-length": "26", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
16662024-12-20T22:16:43.561ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16672024-12-20T22:16:43.563ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16682024-12-20T22:16:43.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16692024-12-20T22:16:43.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16702024-12-20T22:16:43.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16712024-12-20T22:16:43.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16722024-12-20T22:16:43.574ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16732024-12-20T22:16:43.574ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16742024-12-20T22:16:43.574ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.228671ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16752024-12-20T22:16:43.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.11054ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
16762024-12-20T22:16:43.618ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16772024-12-20T22:16:43.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16782024-12-20T22:16:43.623ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16792024-12-20T22:16:43.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16802024-12-20T22:16:43.637ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 196.77028ms iteration = 9 status = {"physical_disks_added":0}
16812024-12-20T22:16:43.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 217.148365ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16822024-12-20T22:16:43.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 219.702351ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16832024-12-20T22:16:43.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16842024-12-20T22:16:43.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16852024-12-20T22:16:43.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16862024-12-20T22:16:43.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16872024-12-20T22:16:43.696ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16882024-12-20T22:16:43.696ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3789313-2c9a-4489-94e7-580d43076850", "content-length": "1", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
16892024-12-20T22:16:43.698ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16902024-12-20T22:16:43.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16912024-12-20T22:16:43.754ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 313.702247ms iteration = 6 status = {}
16922024-12-20T22:16:43.765ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16932024-12-20T22:16:43.765ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16942024-12-20T22:16:43.765ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "59ca830b-baa2-4eeb-9f9a-09b390574205", "content-length": "372", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
16952024-12-20T22:16:43.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16962024-12-20T22:16:43.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16972024-12-20T22:16:43.776ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16982024-12-20T22:16:43.777ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ed2b3dd-44ae-46cd-b553-1b0828b38b84", "content-length": "691", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
16992024-12-20T22:16:43.777ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
17002024-12-20T22:16:43.777ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
17012024-12-20T22:16:43.777ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
17022024-12-20T22:16:43.778ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 338.451156ms iteration = 6 status = {}
17032024-12-20T22:16:43.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17042024-12-20T22:16:43.780ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 340.003442ms iteration = 6 status = null
17052024-12-20T22:16:43.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
17062024-12-20T22:16:43.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17072024-12-20T22:16:43.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17082024-12-20T22:16:43.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17092024-12-20T22:16:43.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17102024-12-20T22:16:43.806ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
17112024-12-20T22:16:43.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17122024-12-20T22:16:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17132024-12-20T22:16:43.827ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17142024-12-20T22:16:43.827ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17152024-12-20T22:16:43.827ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6922accc-5cfe-4bdf-a5ab-4bc2d066fa03", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
17162024-12-20T22:16:43.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17172024-12-20T22:16:43.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17182024-12-20T22:16:43.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17192024-12-20T22:16:43.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17202024-12-20T22:16:43.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17212024-12-20T22:16:43.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17222024-12-20T22:16:43.836ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17232024-12-20T22:16:43.836ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17242024-12-20T22:16:43.836ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "22d4811e-8666-4ead-bb28-4dd9f5effb38", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
17252024-12-20T22:16:43.838ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 397.974366ms iteration = 7 status = {}
17262024-12-20T22:16:43.885ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 445.371982ms iteration = 6 status = 0
17272024-12-20T22:16:43.925ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17282024-12-20T22:16:43.925ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "235543ca-1589-40ec-8faf-731d59b4d1f2", "content-length": "134", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
17292024-12-20T22:16:43.925ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17302024-12-20T22:16:43.925ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
17312024-12-20T22:16:43.926ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17322024-12-20T22:16:43.926ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17332024-12-20T22:16:43.926ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17342024-12-20T22:16:43.926ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17352024-12-20T22:16:43.926ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17362024-12-20T22:16:43.926ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17372024-12-20T22:16:43.926ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17382024-12-20T22:16:43.926ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17392024-12-20T22:16:43.926ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
17402024-12-20T22:16:43.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17412024-12-20T22:16:43.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17422024-12-20T22:16:43.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17432024-12-20T22:16:43.929ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c7172f4-452c-4736-8abe-ecb939899e2f", "content-length": "2", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
17442024-12-20T22:16:43.929ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17452024-12-20T22:16:43.929ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "57b9e223-4363-4ae3-b6a3-d30a1e3cd498", "content-length": "52", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
17462024-12-20T22:16:43.929ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
17472024-12-20T22:16:43.929ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17482024-12-20T22:16:44.014ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "437fd970-63d5-4c1b-806b-9b5c24953dd7", "date": "Fri, 20 Dec 2024 22:16:43 GMT"} })
17492024-12-20T22:16:44.014ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
17502024-12-20T22:16:44.014ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17512024-12-20T22:16:44.015ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c611067-c206-4d4b-8857-61c607784612", "content-length": "682", "date": "Fri, 20 Dec 2024 22:16:44 GMT"} })
17522024-12-20T22:16:44.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17532024-12-20T22:16:44.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17542024-12-20T22:16:44.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17552024-12-20T22:16:44.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17562024-12-20T22:16:44.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17572024-12-20T22:16:44.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17582024-12-20T22:16:44.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17592024-12-20T22:16:44.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17602024-12-20T22:16:44.031ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 591.333211ms iteration = 6 status = {}
17612024-12-20T22:16:44.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = fd641911-b5e0-4352-a0ea-09515339bfef roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17622024-12-20T22:16:44.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = fd641911-b5e0-4352-a0ea-09515339bfef resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17632024-12-20T22:16:44.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = fd641911-b5e0-4352-a0ea-09515339bfef response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17642024-12-20T22:16:44.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d67784d1-085f-42a5-a8d4-b25a9bf9b4f4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17652024-12-20T22:16:44.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d67784d1-085f-42a5-a8d4-b25a9bf9b4f4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17662024-12-20T22:16:44.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d67784d1-085f-42a5-a8d4-b25a9bf9b4f4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17672024-12-20T22:16:45.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12843390-c034-4d27-8c63-89e97800ac4e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17682024-12-20T22:16:45.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12843390-c034-4d27-8c63-89e97800ac4e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17692024-12-20T22:16:45.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12843390-c034-4d27-8c63-89e97800ac4e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17702024-12-20T22:16:45.685ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1429 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 30510138-6dbb-4120-9bc4-a8846a1d90ce response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
17712024-12-20T22:16:46.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9463c812-522a-4d67-8b04-a781e664e6c4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17722024-12-20T22:16:46.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9463c812-522a-4d67-8b04-a781e664e6c4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17732024-12-20T22:16:46.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9463c812-522a-4d67-8b04-a781e664e6c4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17742024-12-20T22:16:47.527ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48246
17752024-12-20T22:16:47.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48246 req_id = 4d1a8afd-d783-40e4-be34-8e8df7eafabb roles = RoleSet { roles: {} } uri = /metrics/producers
17762024-12-20T22:16:47.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48246 req_id = 4d1a8afd-d783-40e4-be34-8e8df7eafabb resource = Database result = Ok(()) uri = /metrics/producers
17772024-12-20T22:16:47.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7a8dcb47-8d82-460e-8480-6b64033d45d9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17782024-12-20T22:16:47.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7a8dcb47-8d82-460e-8480-6b64033d45d9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17792024-12-20T22:16:47.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7a8dcb47-8d82-460e-8480-6b64033d45d9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17802024-12-20T22:16:47.563ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 03760c77-b0c3-42eb-a705-bfee77be2fbe
17812024-12-20T22:16:47.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35489 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48246 req_id = 4d1a8afd-d783-40e4-be34-8e8df7eafabb response_code = 201 uri = /metrics/producers
17822024-12-20T22:16:48.088ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:61755
17832024-12-20T22:16:48.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61755 req_id = 69815a22-f802-4272-a6a2-5d9865967d8a roles = RoleSet { roles: {} } uri = /metrics/producers
17842024-12-20T22:16:48.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61755 req_id = 69815a22-f802-4272-a6a2-5d9865967d8a resource = Database result = Ok(()) uri = /metrics/producers
17852024-12-20T22:16:48.129ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = a0a780c3-0806-4044-8e4b-e91bf0405221
17862024-12-20T22:16:48.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41420 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61755 req_id = 69815a22-f802-4272-a6a2-5d9865967d8a response_code = 201 uri = /metrics/producers
17872024-12-20T22:16:48.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9ad11ff0-4c0b-45fb-ac83-1dd71a37eea1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17882024-12-20T22:16:48.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9ad11ff0-4c0b-45fb-ac83-1dd71a37eea1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17892024-12-20T22:16:48.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9ad11ff0-4c0b-45fb-ac83-1dd71a37eea1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17902024-12-20T22:16:48.764ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52951
17912024-12-20T22:16:48.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52951 req_id = e86192d9-0cae-4ba2-bc61-69ff49c15489 roles = RoleSet { roles: {} } uri = /metrics/producers
17922024-12-20T22:16:48.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52951 req_id = e86192d9-0cae-4ba2-bc61-69ff49c15489 resource = Database result = Ok(()) uri = /metrics/producers
17932024-12-20T22:16:48.774ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 7f6e5691-338a-4d1e-8ab4-9564fc795162
17942024-12-20T22:16:48.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9716 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52951 req_id = e86192d9-0cae-4ba2-bc61-69ff49c15489 response_code = 201 uri = /metrics/producers
17952024-12-20T22:16:49.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca1b96d4-f1b8-43f9-8a5c-9dd684d263e4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17962024-12-20T22:16:49.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca1b96d4-f1b8-43f9-8a5c-9dd684d263e4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17972024-12-20T22:16:49.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca1b96d4-f1b8-43f9-8a5c-9dd684d263e4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17982024-12-20T22:16:50.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a2861a52-bf7f-49d4-b0d8-c927928729e2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
17992024-12-20T22:16:50.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a2861a52-bf7f-49d4-b0d8-c927928729e2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18002024-12-20T22:16:50.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a2861a52-bf7f-49d4-b0d8-c927928729e2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18012024-12-20T22:16:51.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4bbd1850-8357-4837-8e62-c552817962ce roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18022024-12-20T22:16:51.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4bbd1850-8357-4837-8e62-c552817962ce resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18032024-12-20T22:16:51.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4bbd1850-8357-4837-8e62-c552817962ce response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18042024-12-20T22:16:52.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8d96234b-3c31-44f1-b41e-25469e23de5a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18052024-12-20T22:16:52.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8d96234b-3c31-44f1-b41e-25469e23de5a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18062024-12-20T22:16:52.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8d96234b-3c31-44f1-b41e-25469e23de5a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18072024-12-20T22:16:53.439ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
18082024-12-20T22:16:53.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18092024-12-20T22:16:53.439ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
18102024-12-20T22:16:53.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18112024-12-20T22:16:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18122024-12-20T22:16:53.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18132024-12-20T22:16:53.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18142024-12-20T22:16:53.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18152024-12-20T22:16:53.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18162024-12-20T22:16:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18172024-12-20T22:16:53.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18182024-12-20T22:16:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18192024-12-20T22:16:53.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18202024-12-20T22:16:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18212024-12-20T22:16:53.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18222024-12-20T22:16:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
18232024-12-20T22:16:53.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18242024-12-20T22:16:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18252024-12-20T22:16:53.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.306755ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18262024-12-20T22:16:53.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
18272024-12-20T22:16:53.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.802835ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
18282024-12-20T22:16:53.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 97b62661-4f29-4866-9efc-0f388ec1c81e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18292024-12-20T22:16:53.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 97b62661-4f29-4866-9efc-0f388ec1c81e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18302024-12-20T22:16:53.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 97b62661-4f29-4866-9efc-0f388ec1c81e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18312024-12-20T22:16:54.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f54dce34-da87-4bc1-99a8-7612566c9593 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18322024-12-20T22:16:54.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f54dce34-da87-4bc1-99a8-7612566c9593 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18332024-12-20T22:16:54.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f54dce34-da87-4bc1-99a8-7612566c9593 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18342024-12-20T22:16:55.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1329 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 152fbbb8-3cd8-4b94-9692-4bef5ce0bcc3 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
18352024-12-20T22:16:55.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fd32ba40-c47d-4507-9295-bcbaa8109d42 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18362024-12-20T22:16:55.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fd32ba40-c47d-4507-9295-bcbaa8109d42 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18372024-12-20T22:16:55.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fd32ba40-c47d-4507-9295-bcbaa8109d42 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18382024-12-20T22:16:56.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa544bee-237c-4df5-af9d-18411d7b427a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18392024-12-20T22:16:56.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa544bee-237c-4df5-af9d-18411d7b427a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18402024-12-20T22:16:56.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa544bee-237c-4df5-af9d-18411d7b427a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18412024-12-20T22:16:57.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 17fa9beb-61fd-46f7-8da6-893cf22a4bd7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18422024-12-20T22:16:57.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 17fa9beb-61fd-46f7-8da6-893cf22a4bd7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18432024-12-20T22:16:57.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 17fa9beb-61fd-46f7-8da6-893cf22a4bd7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18442024-12-20T22:16:58.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2898cfb8-4ca1-4d97-8fa8-5a6191a1cb65 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18452024-12-20T22:16:58.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2898cfb8-4ca1-4d97-8fa8-5a6191a1cb65 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18462024-12-20T22:16:58.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2898cfb8-4ca1-4d97-8fa8-5a6191a1cb65 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18472024-12-20T22:16:59.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 44e3b7f7-1c7e-4105-9051-66791d2fcc29 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18482024-12-20T22:16:59.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 44e3b7f7-1c7e-4105-9051-66791d2fcc29 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18492024-12-20T22:16:59.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 44e3b7f7-1c7e-4105-9051-66791d2fcc29 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18502024-12-20T22:17:00.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 18235cb0-39e4-4319-a6bb-43f07722178d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18512024-12-20T22:17:00.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 18235cb0-39e4-4319-a6bb-43f07722178d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18522024-12-20T22:17:00.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 18235cb0-39e4-4319-a6bb-43f07722178d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18532024-12-20T22:17:01.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a696ab04-d4a3-472e-93f3-a611121e9f9d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18542024-12-20T22:17:01.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a696ab04-d4a3-472e-93f3-a611121e9f9d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18552024-12-20T22:17:01.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a696ab04-d4a3-472e-93f3-a611121e9f9d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18562024-12-20T22:17:02.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f82f81f1-023e-490b-9171-62ed11dce989 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18572024-12-20T22:17:02.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f82f81f1-023e-490b-9171-62ed11dce989 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18582024-12-20T22:17:02.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f82f81f1-023e-490b-9171-62ed11dce989 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18592024-12-20T22:17:03.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
18602024-12-20T22:17:03.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
18612024-12-20T22:17:03.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18622024-12-20T22:17:03.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18632024-12-20T22:17:03.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18642024-12-20T22:17:03.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18652024-12-20T22:17:03.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18662024-12-20T22:17:03.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18672024-12-20T22:17:03.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18682024-12-20T22:17:03.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.229342ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18692024-12-20T22:17:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18702024-12-20T22:17:03.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18712024-12-20T22:17:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18722024-12-20T22:17:03.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18732024-12-20T22:17:03.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18742024-12-20T22:17:03.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18752024-12-20T22:17:03.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
18762024-12-20T22:17:03.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18772024-12-20T22:17:03.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18782024-12-20T22:17:03.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
18792024-12-20T22:17:03.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.462837ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
18802024-12-20T22:17:03.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e091eec4-7ca7-47c2-b980-b16c78e9d12b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18812024-12-20T22:17:03.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e091eec4-7ca7-47c2-b980-b16c78e9d12b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18822024-12-20T22:17:03.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e091eec4-7ca7-47c2-b980-b16c78e9d12b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18832024-12-20T22:17:04.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c00bbf85-3550-42df-ae37-fca933da5f60 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18842024-12-20T22:17:04.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c00bbf85-3550-42df-ae37-fca933da5f60 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18852024-12-20T22:17:04.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c00bbf85-3550-42df-ae37-fca933da5f60 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18862024-12-20T22:17:05.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 602d06cc-e21d-418d-8b40-1c05953858da response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
18872024-12-20T22:17:05.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3430e21a-bfbb-48e7-9cd7-c7a10d53f428 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18882024-12-20T22:17:05.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3430e21a-bfbb-48e7-9cd7-c7a10d53f428 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18892024-12-20T22:17:05.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3430e21a-bfbb-48e7-9cd7-c7a10d53f428 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18902024-12-20T22:17:06.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 13fa7cbb-0b2e-42fc-ab36-e3d5c6311ed4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18912024-12-20T22:17:06.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 13fa7cbb-0b2e-42fc-ab36-e3d5c6311ed4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18922024-12-20T22:17:06.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 13fa7cbb-0b2e-42fc-ab36-e3d5c6311ed4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18932024-12-20T22:17:07.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6e3c9cec-6fef-4bbd-85c6-c793cc6a1331 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18942024-12-20T22:17:07.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6e3c9cec-6fef-4bbd-85c6-c793cc6a1331 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18952024-12-20T22:17:07.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6e3c9cec-6fef-4bbd-85c6-c793cc6a1331 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18962024-12-20T22:17:09.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dae510a9-067f-43f1-8926-eecfb266842d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18972024-12-20T22:17:09.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dae510a9-067f-43f1-8926-eecfb266842d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18982024-12-20T22:17:09.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dae510a9-067f-43f1-8926-eecfb266842d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
18992024-12-20T22:17:10.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e2db46b5-4f5a-426b-b3aa-a60f8605ffba roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19002024-12-20T22:17:10.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e2db46b5-4f5a-426b-b3aa-a60f8605ffba resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19012024-12-20T22:17:10.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e2db46b5-4f5a-426b-b3aa-a60f8605ffba response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19022024-12-20T22:17:11.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ea8cd8cb-3cf8-4562-bd66-ccf2f37331a9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19032024-12-20T22:17:11.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ea8cd8cb-3cf8-4562-bd66-ccf2f37331a9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19042024-12-20T22:17:11.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ea8cd8cb-3cf8-4562-bd66-ccf2f37331a9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19052024-12-20T22:17:12.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b4d07c05-f988-4f36-bc21-62b0464e2aa1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19062024-12-20T22:17:12.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b4d07c05-f988-4f36-bc21-62b0464e2aa1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19072024-12-20T22:17:12.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b4d07c05-f988-4f36-bc21-62b0464e2aa1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19082024-12-20T22:17:13.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3fe8e30-8820-433b-bf6a-6b7219168bc2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19092024-12-20T22:17:13.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3fe8e30-8820-433b-bf6a-6b7219168bc2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19102024-12-20T22:17:13.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3fe8e30-8820-433b-bf6a-6b7219168bc2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
19112024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
19122024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
19132024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
19142024-12-20T22:17:13.440ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
19152024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19162024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19172024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
19182024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19192024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
19202024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19212024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
19222024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19232024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
19242024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
19252024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19262024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
19272024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19282024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
19292024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19302024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
19312024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19322024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
19332024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
19342024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19352024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
19362024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19372024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19382024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
19392024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19402024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
19412024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
19422024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
19432024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
19442024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19452024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
19462024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19472024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
19482024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19492024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
19502024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
19512024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
19522024-12-20T22:17:13.440ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:07:13.440465798 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
19532024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
19542024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
19552024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
19562024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19572024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
19582024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
19592024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19602024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
19612024-12-20T22:17:13.440ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19622024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19632024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19642024-12-20T22:17:13.440ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
19652024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
19662024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
19672024-12-20T22:17:13.441ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
19682024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
19692024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.26\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
19702024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19712024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
19722024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19732024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
19742024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19752024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19762024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19772024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19782024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19792024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19802024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19812024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19822024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19832024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19842024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19852024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19862024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19872024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19882024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19892024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19902024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
19912024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
19922024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19932024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19942024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19952024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19962024-12-20T22:17:13.441ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1060, tv_nsec: 371116324 } })
19972024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19982024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19992024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20002024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20012024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20022024-12-20T22:17:13.441ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1060, tv_nsec: 371230716 } })
20032024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20042024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20052024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20062024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20072024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20082024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20092024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
20102024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.331754ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
20112024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
20122024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.638717ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
20132024-12-20T22:17:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20142024-12-20T22:17:13.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20152024-12-20T22:17:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20162024-12-20T22:17:13.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20172024-12-20T22:17:13.444ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.475855ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20182024-12-20T22:17:13.445ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1060, tv_nsec: 374918193 } })
20192024-12-20T22:17:13.445ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
20202024-12-20T22:17:13.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20212024-12-20T22:17:13.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20222024-12-20T22:17:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20232024-12-20T22:17:13.449ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:07:13.440465798 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
20242024-12-20T22:17:13.449ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.912909ms iteration = 4 status = {"expiration":"2024-12-20T22:07:13.440465798Z","pruned":[]}
20252024-12-20T22:17:13.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20262024-12-20T22:17:13.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20272024-12-20T22:17:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20282024-12-20T22:17:13.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20292024-12-20T22:17:13.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20302024-12-20T22:17:13.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20312024-12-20T22:17:13.455ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.664147ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
20322024-12-20T22:17:13.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20332024-12-20T22:17:13.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20342024-12-20T22:17:13.459ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20352024-12-20T22:17:13.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20362024-12-20T22:17:13.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20372024-12-20T22:17:13.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20382024-12-20T22:17:13.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20392024-12-20T22:17:13.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20402024-12-20T22:17:13.475ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20412024-12-20T22:17:13.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20422024-12-20T22:17:13.478ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20432024-12-20T22:17:13.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20442024-12-20T22:17:13.490ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20452024-12-20T22:17:13.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20462024-12-20T22:17:13.493ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20472024-12-20T22:17:13.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20482024-12-20T22:17:13.496ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20492024-12-20T22:17:13.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20502024-12-20T22:17:13.498ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20512024-12-20T22:17:13.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20522024-12-20T22:17:13.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20532024-12-20T22:17:13.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20542024-12-20T22:17:13.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20552024-12-20T22:17:13.503ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20562024-12-20T22:17:13.504ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20572024-12-20T22:17:13.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20582024-12-20T22:17:13.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.939063ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
20592024-12-20T22:17:13.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20602024-12-20T22:17:13.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20612024-12-20T22:17:13.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.408468ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
20622024-12-20T22:17:13.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20632024-12-20T22:17:13.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20642024-12-20T22:17:13.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20652024-12-20T22:17:13.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20662024-12-20T22:17:13.508ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20672024-12-20T22:17:13.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20682024-12-20T22:17:13.511ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20692024-12-20T22:17:13.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20702024-12-20T22:17:13.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20712024-12-20T22:17:13.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20722024-12-20T22:17:13.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20732024-12-20T22:17:13.513ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
20742024-12-20T22:17:13.513ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
20752024-12-20T22:17:13.513ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.081285ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
20762024-12-20T22:17:13.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20772024-12-20T22:17:13.514ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20782024-12-20T22:17:13.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20792024-12-20T22:17:13.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20802024-12-20T22:17:13.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20812024-12-20T22:17:13.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20822024-12-20T22:17:13.516ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20832024-12-20T22:17:13.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20842024-12-20T22:17:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20852024-12-20T22:17:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20862024-12-20T22:17:13.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20872024-12-20T22:17:13.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20882024-12-20T22:17:13.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20892024-12-20T22:17:13.520ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20902024-12-20T22:17:13.520ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20912024-12-20T22:17:13.520ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20922024-12-20T22:17:13.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20932024-12-20T22:17:13.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20942024-12-20T22:17:13.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20952024-12-20T22:17:13.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20962024-12-20T22:17:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20972024-12-20T22:17:13.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20982024-12-20T22:17:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20992024-12-20T22:17:13.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21002024-12-20T22:17:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
21012024-12-20T22:17:13.553ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21022024-12-20T22:17:13.559ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
21032024-12-20T22:17:13.559ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
21042024-12-20T22:17:13.559ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
21052024-12-20T22:17:13.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21062024-12-20T22:17:13.559ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
21072024-12-20T22:17:13.559ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
21082024-12-20T22:17:13.559ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
21092024-12-20T22:17:13.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21102024-12-20T22:17:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21112024-12-20T22:17:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21122024-12-20T22:17:13.561ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21132024-12-20T22:17:13.561ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 121.358961ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21142024-12-20T22:17:13.562ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
21152024-12-20T22:17:13.563ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1060, tv_nsec: 492891010 } })
21162024-12-20T22:17:13.563ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
21172024-12-20T22:17:13.565ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21182024-12-20T22:17:13.565ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21192024-12-20T22:17:13.566ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a9abdd7-3856-4bc0-afba-f7217f35f62e", "content-length": "26", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
21202024-12-20T22:17:13.566ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21212024-12-20T22:17:13.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21222024-12-20T22:17:13.567ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21232024-12-20T22:17:13.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21242024-12-20T22:17:13.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21252024-12-20T22:17:13.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21262024-12-20T22:17:13.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21272024-12-20T22:17:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21282024-12-20T22:17:13.649ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
21292024-12-20T22:17:13.650ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21302024-12-20T22:17:13.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21312024-12-20T22:17:13.651ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21322024-12-20T22:17:13.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21332024-12-20T22:17:13.652ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21342024-12-20T22:17:13.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21352024-12-20T22:17:13.653ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21362024-12-20T22:17:13.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21372024-12-20T22:17:13.656ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21382024-12-20T22:17:13.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21392024-12-20T22:17:13.658ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f319247-8420-4c2d-bd03-f4052cd5cc6d", "content-length": "64", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
21402024-12-20T22:17:13.658ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21412024-12-20T22:17:13.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21422024-12-20T22:17:13.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21432024-12-20T22:17:13.659ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1060, tv_nsec: 589318551 } })
21442024-12-20T22:17:13.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21452024-12-20T22:17:13.659ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
21462024-12-20T22:17:13.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21472024-12-20T22:17:13.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21482024-12-20T22:17:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21492024-12-20T22:17:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
21502024-12-20T22:17:13.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21512024-12-20T22:17:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21522024-12-20T22:17:13.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21532024-12-20T22:17:13.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21542024-12-20T22:17:13.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21552024-12-20T22:17:13.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21562024-12-20T22:17:13.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21572024-12-20T22:17:13.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21582024-12-20T22:17:13.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21592024-12-20T22:17:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21602024-12-20T22:17:13.670ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21612024-12-20T22:17:13.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21622024-12-20T22:17:13.692ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 251.933106ms iteration = 3 status = {"nsuccess":5}
21632024-12-20T22:17:13.699ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
21642024-12-20T22:17:13.700ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1a36389f-4c80-41a5-b047-4bead2e7101f", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21652024-12-20T22:17:13.700ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21662024-12-20T22:17:13.702ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21672024-12-20T22:17:13.702ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21682024-12-20T22:17:13.702ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a25380d-eb63-4a94-95c0-6bea4f98804a", "content-length": "26", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
21692024-12-20T22:17:13.702ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21702024-12-20T22:17:13.702ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
21712024-12-20T22:17:13.702ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
21722024-12-20T22:17:13.702ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b2187a67-4ad4-4258-ba64-7c2bc10abe8c", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21732024-12-20T22:17:13.702ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21742024-12-20T22:17:13.702ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 262.523342ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
21752024-12-20T22:17:13.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21762024-12-20T22:17:13.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21772024-12-20T22:17:13.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 264.800835ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21782024-12-20T22:17:13.706ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21792024-12-20T22:17:13.706ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21802024-12-20T22:17:13.706ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 266.517933ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21812024-12-20T22:17:13.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 266.859406ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21822024-12-20T22:17:13.707ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21832024-12-20T22:17:13.707ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21842024-12-20T22:17:13.707ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21852024-12-20T22:17:13.707ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 267.25129ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
21862024-12-20T22:17:13.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21872024-12-20T22:17:13.708ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 268.754215ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21882024-12-20T22:17:13.712ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
21892024-12-20T22:17:13.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 272.388741ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
21902024-12-20T22:17:13.713ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21912024-12-20T22:17:13.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21922024-12-20T22:17:13.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21932024-12-20T22:17:13.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21942024-12-20T22:17:13.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21952024-12-20T22:17:13.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21962024-12-20T22:17:13.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21972024-12-20T22:17:13.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21982024-12-20T22:17:13.717ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21992024-12-20T22:17:13.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22002024-12-20T22:17:13.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22012024-12-20T22:17:13.717ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
22022024-12-20T22:17:13.717ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
22032024-12-20T22:17:13.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22042024-12-20T22:17:13.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22052024-12-20T22:17:13.719ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 278.854377ms iteration = 7 status = {}
22062024-12-20T22:17:13.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
22072024-12-20T22:17:13.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22082024-12-20T22:17:13.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22092024-12-20T22:17:13.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22102024-12-20T22:17:13.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22112024-12-20T22:17:13.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22122024-12-20T22:17:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22132024-12-20T22:17:13.736ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
22142024-12-20T22:17:13.736ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
22152024-12-20T22:17:13.737ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
22162024-12-20T22:17:13.737ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 296.902218ms iteration = 5 status = {"generation":2}
22172024-12-20T22:17:13.755ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22182024-12-20T22:17:13.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
22192024-12-20T22:17:13.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22202024-12-20T22:17:13.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22212024-12-20T22:17:13.767ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 326.83022ms iteration = 7 status = 0
22222024-12-20T22:17:13.771ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
22232024-12-20T22:17:13.771ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22242024-12-20T22:17:13.772ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fbc30da-aa29-4159-a122-c8c42a38401e", "content-length": "26", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
22252024-12-20T22:17:13.772ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22262024-12-20T22:17:13.774ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
22272024-12-20T22:17:13.792ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
22282024-12-20T22:17:13.792ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
22292024-12-20T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22302024-12-20T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22312024-12-20T22:17:13.797ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
22322024-12-20T22:17:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 357.594659ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
22332024-12-20T22:17:13.807ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
22342024-12-20T22:17:13.807ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 367.198145ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
22352024-12-20T22:17:13.826ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 386.269528ms iteration = 10 status = {"physical_disks_added":0}
22362024-12-20T22:17:13.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22372024-12-20T22:17:13.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22382024-12-20T22:17:13.829ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22392024-12-20T22:17:13.829ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "06cc29bb-6add-4248-bac4-4130f569cd5f", "content-length": "1", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
22402024-12-20T22:17:13.833ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22412024-12-20T22:17:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22422024-12-20T22:17:13.837ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 397.101616ms iteration = 7 status = null
22432024-12-20T22:17:13.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
22442024-12-20T22:17:13.838ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "028e93e0-68c0-4efd-8bb5-152c0038b3d3", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22452024-12-20T22:17:13.839ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22462024-12-20T22:17:13.841ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "70437fc0-338f-4abd-9c39-9026f87a990d", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22472024-12-20T22:17:13.841ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22482024-12-20T22:17:13.843ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c9f8341f-19d0-482e-9c7b-2250f80edc2c", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22492024-12-20T22:17:13.843ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22502024-12-20T22:17:13.845ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22512024-12-20T22:17:13.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 404.949276ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
22522024-12-20T22:17:13.849ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
22532024-12-20T22:17:13.849ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 408.580012ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
22542024-12-20T22:17:13.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22552024-12-20T22:17:13.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22562024-12-20T22:17:13.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22572024-12-20T22:17:13.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22582024-12-20T22:17:13.858ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22592024-12-20T22:17:13.858ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22602024-12-20T22:17:13.859ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "615e2376-997c-4b28-83a1-fc21a06ef54f", "content-length": "372", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
22612024-12-20T22:17:13.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22622024-12-20T22:17:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22632024-12-20T22:17:13.860ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
22642024-12-20T22:17:13.860ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
22652024-12-20T22:17:13.860ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
22662024-12-20T22:17:13.860ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 420.558243ms iteration = 5 status = {"generation":1}
22672024-12-20T22:17:13.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22682024-12-20T22:17:13.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22692024-12-20T22:17:13.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22702024-12-20T22:17:13.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22712024-12-20T22:17:13.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22722024-12-20T22:17:13.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22732024-12-20T22:17:13.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22742024-12-20T22:17:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22752024-12-20T22:17:13.929ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
22762024-12-20T22:17:13.929ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22772024-12-20T22:17:13.929ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ceb87b40-1ec8-400e-9591-21609c3a8696", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
22782024-12-20T22:17:13.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22792024-12-20T22:17:13.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22802024-12-20T22:17:13.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22812024-12-20T22:17:13.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22822024-12-20T22:17:13.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22832024-12-20T22:17:13.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22842024-12-20T22:17:13.940ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22852024-12-20T22:17:13.940ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22862024-12-20T22:17:13.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22872024-12-20T22:17:13.940ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "30e90ca6-533d-4f2c-aef0-41fc1349a178", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
22882024-12-20T22:17:13.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22892024-12-20T22:17:13.942ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 502.095014ms iteration = 8 status = {}
22902024-12-20T22:17:13.943ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
22912024-12-20T22:17:13.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22922024-12-20T22:17:13.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22932024-12-20T22:17:13.957ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22942024-12-20T22:17:13.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "19718377-e8b4-4624-8e61-d347a5358d3c", "content-length": "134", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
22952024-12-20T22:17:13.958ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22962024-12-20T22:17:13.958ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
22972024-12-20T22:17:13.958ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22982024-12-20T22:17:13.958ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22992024-12-20T22:17:13.958ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23002024-12-20T22:17:13.958ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23012024-12-20T22:17:13.958ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23022024-12-20T22:17:13.958ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23032024-12-20T22:17:13.958ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23042024-12-20T22:17:13.958ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23052024-12-20T22:17:13.959ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
23062024-12-20T22:17:13.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23072024-12-20T22:17:13.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23082024-12-20T22:17:13.961ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
23092024-12-20T22:17:13.962ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1b2a312-7f7f-4547-9e79-d0e2cb0b0ba6", "content-length": "2", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
23102024-12-20T22:17:13.962ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23112024-12-20T22:17:13.962ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bc8aba1-fd92-418a-ba57-8aaad24b3551", "content-length": "52", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
23122024-12-20T22:17:13.962ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
23132024-12-20T22:17:13.962ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
23142024-12-20T22:17:14.020ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23152024-12-20T22:17:14.072ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "92bf3ff4-2cb9-47b0-8d4b-8b04a0897d91", "date": "Fri, 20 Dec 2024 22:17:13 GMT"} })
23162024-12-20T22:17:14.072ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
23172024-12-20T22:17:14.072ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23182024-12-20T22:17:14.073ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "15894739-d97e-453a-be9f-b393bbe46992", "content-length": "682", "date": "Fri, 20 Dec 2024 22:17:14 GMT"} })
23192024-12-20T22:17:14.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23202024-12-20T22:17:14.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23212024-12-20T22:17:14.073ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "795658d1-5747-441a-a77a-eb5885dd7f97", "content-length": "691", "date": "Fri, 20 Dec 2024 22:17:14 GMT"} })
23222024-12-20T22:17:14.073ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23232024-12-20T22:17:14.073ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23242024-12-20T22:17:14.073ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23252024-12-20T22:17:14.075ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 634.91493ms iteration = 7 status = {}
23262024-12-20T22:17:14.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23272024-12-20T22:17:14.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23282024-12-20T22:17:14.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9471d75a-007f-4305-998f-dbf5290c1b22 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23292024-12-20T22:17:14.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9471d75a-007f-4305-998f-dbf5290c1b22 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23302024-12-20T22:17:14.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9471d75a-007f-4305-998f-dbf5290c1b22 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23312024-12-20T22:17:14.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23322024-12-20T22:17:14.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23332024-12-20T22:17:14.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23342024-12-20T22:17:14.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23352024-12-20T22:17:14.192ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 752.566364ms iteration = 7 status = {}
23362024-12-20T22:17:14.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 3c5ec8df-21ba-448d-bb29-8d503e738ee0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
23372024-12-20T22:17:14.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 3c5ec8df-21ba-448d-bb29-8d503e738ee0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
23382024-12-20T22:17:14.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 3c5ec8df-21ba-448d-bb29-8d503e738ee0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
23392024-12-20T22:17:15.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7d3bf1d5-2562-4321-a73b-176d161269e9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23402024-12-20T22:17:15.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7d3bf1d5-2562-4321-a73b-176d161269e9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23412024-12-20T22:17:15.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7d3bf1d5-2562-4321-a73b-176d161269e9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23422024-12-20T22:17:15.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1274 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = ffda0c19-698c-4006-90d4-e79022fff930 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
23432024-12-20T22:17:16.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 125fdcb3-ab1d-4b45-8734-68f7cae092a5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23442024-12-20T22:17:16.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 125fdcb3-ab1d-4b45-8734-68f7cae092a5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23452024-12-20T22:17:16.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 125fdcb3-ab1d-4b45-8734-68f7cae092a5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23462024-12-20T22:17:17.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7b167d2b-5b79-4d00-b7f9-e8b117e6e1f6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23472024-12-20T22:17:17.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7b167d2b-5b79-4d00-b7f9-e8b117e6e1f6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23482024-12-20T22:17:17.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7b167d2b-5b79-4d00-b7f9-e8b117e6e1f6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23492024-12-20T22:17:18.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e7b74a8d-5dd1-40a0-b4fd-8aae8e6741e2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23502024-12-20T22:17:18.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e7b74a8d-5dd1-40a0-b4fd-8aae8e6741e2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23512024-12-20T22:17:18.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e7b74a8d-5dd1-40a0-b4fd-8aae8e6741e2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23522024-12-20T22:17:19.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 49ffadbf-27c9-4822-97f6-f23730785419 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23532024-12-20T22:17:19.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 49ffadbf-27c9-4822-97f6-f23730785419 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23542024-12-20T22:17:19.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 49ffadbf-27c9-4822-97f6-f23730785419 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23552024-12-20T22:17:19.250ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
23562024-12-20T22:17:19.250ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
23572024-12-20T22:17:19.281ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
23582024-12-20T22:17:19.281ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:54035
23592024-12-20T22:17:19.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54035 req_id = baf0ea84-a882-4828-b371-8b92c3e2119f roles = RoleSet { roles: {} } uri = /metrics/producers
23602024-12-20T22:17:19.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54035 req_id = baf0ea84-a882-4828-b371-8b92c3e2119f resource = Database result = Ok(()) uri = /metrics/producers
23612024-12-20T22:17:19.320ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
23622024-12-20T22:17:19.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38635 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54035 req_id = baf0ea84-a882-4828-b371-8b92c3e2119f response_code = 201 uri = /metrics/producers
23632024-12-20T22:17:19.320ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "baf0ea84-a882-4828-b371-8b92c3e2119f", "content-length": "41", "date": "Fri, 20 Dec 2024 22:17:19 GMT"} })
23642024-12-20T22:17:19.322ZDEBGnexus (producer-registration-task): registered with nexus successfully
23652024-12-20T22:17:19.322ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
23662024-12-20T22:17:20.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f91f46c8-e371-4e99-8db8-aec6d1777b72 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23672024-12-20T22:17:20.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f91f46c8-e371-4e99-8db8-aec6d1777b72 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23682024-12-20T22:17:20.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f91f46c8-e371-4e99-8db8-aec6d1777b72 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23692024-12-20T22:17:21.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3a55ac7c-5d7f-4b79-83c2-3106f24ca222 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23702024-12-20T22:17:21.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3a55ac7c-5d7f-4b79-83c2-3106f24ca222 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23712024-12-20T22:17:21.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3a55ac7c-5d7f-4b79-83c2-3106f24ca222 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23722024-12-20T22:17:22.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 78efee13-01e3-4f3b-b93d-c5cc316b01ad roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23732024-12-20T22:17:22.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 78efee13-01e3-4f3b-b93d-c5cc316b01ad resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23742024-12-20T22:17:22.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 78efee13-01e3-4f3b-b93d-c5cc316b01ad response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23752024-12-20T22:17:23.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e5ce8c34-ecfa-4413-91a9-95e30b0e5046 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23762024-12-20T22:17:23.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e5ce8c34-ecfa-4413-91a9-95e30b0e5046 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23772024-12-20T22:17:23.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e5ce8c34-ecfa-4413-91a9-95e30b0e5046 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
23782024-12-20T22:17:23.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
23792024-12-20T22:17:23.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
23802024-12-20T22:17:23.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23812024-12-20T22:17:23.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23822024-12-20T22:17:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23832024-12-20T22:17:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23842024-12-20T22:17:23.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23852024-12-20T22:17:23.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23862024-12-20T22:17:23.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23872024-12-20T22:17:23.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23882024-12-20T22:17:23.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23892024-12-20T22:17:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23902024-12-20T22:17:23.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23912024-12-20T22:17:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
23922024-12-20T22:17:23.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23932024-12-20T22:17:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23942024-12-20T22:17:23.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23952024-12-20T22:17:23.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23962024-12-20T22:17:23.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.334527ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23972024-12-20T22:17:23.680ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
23982024-12-20T22:17:23.680ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 240.539381ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
23992024-12-20T22:17:24.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2f4ed95a-de27-459c-bb65-61bbdde013e8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24002024-12-20T22:17:24.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2f4ed95a-de27-459c-bb65-61bbdde013e8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24012024-12-20T22:17:24.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2f4ed95a-de27-459c-bb65-61bbdde013e8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24022024-12-20T22:17:25.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d4dac95-4388-43d8-9626-db5d350dccc2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24032024-12-20T22:17:25.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d4dac95-4388-43d8-9626-db5d350dccc2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24042024-12-20T22:17:25.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d4dac95-4388-43d8-9626-db5d350dccc2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24052024-12-20T22:17:25.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 6020fc65-94f6-4053-bf08-584ccf1e1197 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
24062024-12-20T22:17:26.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2ffbea64-ed55-41a0-8d3c-d6042a73410d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24072024-12-20T22:17:26.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2ffbea64-ed55-41a0-8d3c-d6042a73410d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24082024-12-20T22:17:26.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2ffbea64-ed55-41a0-8d3c-d6042a73410d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24092024-12-20T22:17:27.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4f3d5502-ea1a-4aaa-a1af-d54d215adb1f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24102024-12-20T22:17:27.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4f3d5502-ea1a-4aaa-a1af-d54d215adb1f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24112024-12-20T22:17:27.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4f3d5502-ea1a-4aaa-a1af-d54d215adb1f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24122024-12-20T22:17:28.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 04b22b81-c142-4059-beaa-6087736cbb7d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24132024-12-20T22:17:28.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 04b22b81-c142-4059-beaa-6087736cbb7d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24142024-12-20T22:17:28.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 04b22b81-c142-4059-beaa-6087736cbb7d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24152024-12-20T22:17:29.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 020f15d3-ea3e-4a29-a4a9-2dde431ca229 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24162024-12-20T22:17:29.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 020f15d3-ea3e-4a29-a4a9-2dde431ca229 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24172024-12-20T22:17:29.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 020f15d3-ea3e-4a29-a4a9-2dde431ca229 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24182024-12-20T22:17:30.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d024dbac-abcf-4074-bfe9-13b7404b5a07 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24192024-12-20T22:17:30.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d024dbac-abcf-4074-bfe9-13b7404b5a07 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24202024-12-20T22:17:30.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d024dbac-abcf-4074-bfe9-13b7404b5a07 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24212024-12-20T22:17:31.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23a3deeb-8e4d-4eb5-9613-7145a13631e1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24222024-12-20T22:17:31.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23a3deeb-8e4d-4eb5-9613-7145a13631e1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24232024-12-20T22:17:31.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23a3deeb-8e4d-4eb5-9613-7145a13631e1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24242024-12-20T22:17:32.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 59fdb841-bec7-4129-a412-a38d93e2a82b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24252024-12-20T22:17:32.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 59fdb841-bec7-4129-a412-a38d93e2a82b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24262024-12-20T22:17:32.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 59fdb841-bec7-4129-a412-a38d93e2a82b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24272024-12-20T22:17:33.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
24282024-12-20T22:17:33.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
24292024-12-20T22:17:33.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24302024-12-20T22:17:33.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24312024-12-20T22:17:33.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24322024-12-20T22:17:33.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24332024-12-20T22:17:33.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24342024-12-20T22:17:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24352024-12-20T22:17:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24362024-12-20T22:17:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24372024-12-20T22:17:33.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24382024-12-20T22:17:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24392024-12-20T22:17:33.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24402024-12-20T22:17:33.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
24412024-12-20T22:17:33.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24422024-12-20T22:17:33.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24432024-12-20T22:17:33.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
24442024-12-20T22:17:33.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.654158ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
24452024-12-20T22:17:33.473ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24462024-12-20T22:17:33.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24472024-12-20T22:17:33.475ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.038733ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24482024-12-20T22:17:33.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8051e87-1768-41f5-84e1-6d7ca6211275 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24492024-12-20T22:17:33.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8051e87-1768-41f5-84e1-6d7ca6211275 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24502024-12-20T22:17:33.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8051e87-1768-41f5-84e1-6d7ca6211275 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24512024-12-20T22:17:34.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93f22d74-bffa-4bd6-a004-e681b11ce673 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24522024-12-20T22:17:34.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93f22d74-bffa-4bd6-a004-e681b11ce673 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24532024-12-20T22:17:34.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93f22d74-bffa-4bd6-a004-e681b11ce673 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24542024-12-20T22:17:35.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba68f520-2d25-4ae1-b842-b74261b0d241 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24552024-12-20T22:17:35.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba68f520-2d25-4ae1-b842-b74261b0d241 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24562024-12-20T22:17:35.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba68f520-2d25-4ae1-b842-b74261b0d241 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24572024-12-20T22:17:35.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1372 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 9eb9cecb-90ea-4b5a-a8e5-67269e9d3179 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
24582024-12-20T22:17:36.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d1b78e75-3563-4855-8058-004535af3e96 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24592024-12-20T22:17:36.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d1b78e75-3563-4855-8058-004535af3e96 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24602024-12-20T22:17:36.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d1b78e75-3563-4855-8058-004535af3e96 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24612024-12-20T22:17:37.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1afe1267-0a0b-4d0f-942c-20c7340feac7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24622024-12-20T22:17:37.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1afe1267-0a0b-4d0f-942c-20c7340feac7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24632024-12-20T22:17:37.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1afe1267-0a0b-4d0f-942c-20c7340feac7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24642024-12-20T22:17:38.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 31ac2eda-c0f7-45ae-b00f-3ffb1c3f6d35 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24652024-12-20T22:17:38.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 31ac2eda-c0f7-45ae-b00f-3ffb1c3f6d35 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24662024-12-20T22:17:38.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 31ac2eda-c0f7-45ae-b00f-3ffb1c3f6d35 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24672024-12-20T22:17:39.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3faf5cf1-31bd-48b5-b711-0ae1a0356655 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24682024-12-20T22:17:39.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3faf5cf1-31bd-48b5-b711-0ae1a0356655 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24692024-12-20T22:17:39.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3faf5cf1-31bd-48b5-b711-0ae1a0356655 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24702024-12-20T22:17:40.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d15b5e7-65bd-4644-89fa-fd6dc1b0231a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24712024-12-20T22:17:40.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d15b5e7-65bd-4644-89fa-fd6dc1b0231a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24722024-12-20T22:17:40.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d15b5e7-65bd-4644-89fa-fd6dc1b0231a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24732024-12-20T22:17:41.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 513485ee-ceb3-4204-8dcf-c2a963c4be7b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24742024-12-20T22:17:41.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 513485ee-ceb3-4204-8dcf-c2a963c4be7b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24752024-12-20T22:17:41.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 513485ee-ceb3-4204-8dcf-c2a963c4be7b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24762024-12-20T22:17:42.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca1c08dd-868d-4a6a-9439-63b0c479c29f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24772024-12-20T22:17:42.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca1c08dd-868d-4a6a-9439-63b0c479c29f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24782024-12-20T22:17:42.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca1c08dd-868d-4a6a-9439-63b0c479c29f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
24792024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
24802024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
24812024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24822024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
24832024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24842024-12-20T22:17:43.440ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24852024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24862024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
24872024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24882024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
24892024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
24902024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24912024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24922024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
24932024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24942024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
24952024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24962024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
24972024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24982024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
24992024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
25002024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25012024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25022024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
25032024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
25042024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
25052024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25062024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25072024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
25082024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25092024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
25102024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25112024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
25122024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25132024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25142024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25152024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25162024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
25172024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25182024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25192024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25202024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25212024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25222024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25232024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25242024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25252024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25262024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
25272024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25282024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25292024-12-20T22:17:43.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25302024-12-20T22:17:43.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25312024-12-20T22:17:43.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25322024-12-20T22:17:43.443ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.485735ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25332024-12-20T22:17:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25342024-12-20T22:17:43.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25352024-12-20T22:17:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25362024-12-20T22:17:43.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25372024-12-20T22:17:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25382024-12-20T22:17:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25392024-12-20T22:17:43.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25402024-12-20T22:17:43.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25412024-12-20T22:17:43.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1090, tv_nsec: 380213246 } })
25422024-12-20T22:17:43.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
25432024-12-20T22:17:43.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1090, tv_nsec: 380747981 } })
25442024-12-20T22:17:43.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
25452024-12-20T22:17:43.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25462024-12-20T22:17:43.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25472024-12-20T22:17:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25482024-12-20T22:17:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25492024-12-20T22:17:43.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25502024-12-20T22:17:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25512024-12-20T22:17:43.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25522024-12-20T22:17:43.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25532024-12-20T22:17:43.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25542024-12-20T22:17:43.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25552024-12-20T22:17:43.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25562024-12-20T22:17:43.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25572024-12-20T22:17:43.458ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25582024-12-20T22:17:43.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25592024-12-20T22:17:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25602024-12-20T22:17:43.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25612024-12-20T22:17:43.459ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1090, tv_nsec: 389546820 } })
25622024-12-20T22:17:43.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25632024-12-20T22:17:43.460ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
25642024-12-20T22:17:43.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25652024-12-20T22:17:43.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25662024-12-20T22:17:43.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25672024-12-20T22:17:43.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25682024-12-20T22:17:43.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25692024-12-20T22:17:43.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25702024-12-20T22:17:43.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25712024-12-20T22:17:43.470ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25722024-12-20T22:17:43.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25732024-12-20T22:17:43.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
25742024-12-20T22:17:43.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25752024-12-20T22:17:43.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25762024-12-20T22:17:43.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25772024-12-20T22:17:43.479ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25782024-12-20T22:17:43.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25792024-12-20T22:17:43.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25802024-12-20T22:17:43.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25812024-12-20T22:17:43.499ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25822024-12-20T22:17:43.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25832024-12-20T22:17:43.501ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
25842024-12-20T22:17:43.501ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.935974ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
25852024-12-20T22:17:43.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.135985ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
25862024-12-20T22:17:43.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25872024-12-20T22:17:43.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25882024-12-20T22:17:43.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25892024-12-20T22:17:43.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25902024-12-20T22:17:43.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25912024-12-20T22:17:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25922024-12-20T22:17:43.513ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25932024-12-20T22:17:43.514ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25942024-12-20T22:17:43.514ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25952024-12-20T22:17:43.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25962024-12-20T22:17:43.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.239187ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
25972024-12-20T22:17:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25982024-12-20T22:17:43.515ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25992024-12-20T22:17:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26002024-12-20T22:17:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
26012024-12-20T22:17:43.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26022024-12-20T22:17:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26032024-12-20T22:17:43.519ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.959235ms iteration = 8 status = 0
26042024-12-20T22:17:43.528ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26052024-12-20T22:17:43.528ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.339869ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26062024-12-20T22:17:43.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.175208ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26072024-12-20T22:17:43.538ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 97.839275ms iteration = 11 status = {"physical_disks_added":0}
26082024-12-20T22:17:43.547ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26092024-12-20T22:17:43.547ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26102024-12-20T22:17:43.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26112024-12-20T22:17:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26122024-12-20T22:17:43.548ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26132024-12-20T22:17:43.548ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26142024-12-20T22:17:43.548ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26152024-12-20T22:17:43.548ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26162024-12-20T22:17:43.548ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85b1717e-8602-4113-b4f6-1e80708fcda7", "content-length": "26", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
26172024-12-20T22:17:43.548ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26182024-12-20T22:17:43.548ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4391a7f2-708a-45a2-98d7-c9ea9e70a347", "content-length": "26", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
26192024-12-20T22:17:43.548ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26202024-12-20T22:17:43.548ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26212024-12-20T22:17:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26222024-12-20T22:17:43.550ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26232024-12-20T22:17:43.551ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26242024-12-20T22:17:43.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.175999ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26252024-12-20T22:17:43.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 115.858235ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26262024-12-20T22:17:43.574ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
26272024-12-20T22:17:43.575ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26282024-12-20T22:17:43.575ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cad1b1e3-dbf9-4523-983a-9f82411f5a09", "content-length": "26", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
26292024-12-20T22:17:43.575ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26302024-12-20T22:17:43.577ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
26312024-12-20T22:17:43.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.903158ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
26322024-12-20T22:17:43.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26332024-12-20T22:17:43.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26342024-12-20T22:17:43.590ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26352024-12-20T22:17:43.590ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26362024-12-20T22:17:43.590ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.281852ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26372024-12-20T22:17:43.666ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26382024-12-20T22:17:43.666ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26392024-12-20T22:17:43.666ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bb4e0f6-ebec-4971-a1d8-cfb69cbbacf1", "content-length": "372", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
26402024-12-20T22:17:43.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26412024-12-20T22:17:43.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26422024-12-20T22:17:43.670ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 230.679522ms iteration = 8 status = {}
26432024-12-20T22:17:43.674ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26442024-12-20T22:17:43.674ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf72dc05-1ccd-450a-b8fb-8de32b04281b", "content-length": "1", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
26452024-12-20T22:17:43.676ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26462024-12-20T22:17:43.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26472024-12-20T22:17:43.678ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 238.43077ms iteration = 8 status = null
26482024-12-20T22:17:43.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26492024-12-20T22:17:43.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26502024-12-20T22:17:43.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26512024-12-20T22:17:43.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26522024-12-20T22:17:43.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26532024-12-20T22:17:43.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26542024-12-20T22:17:43.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26552024-12-20T22:17:43.703ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26562024-12-20T22:17:43.703ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26572024-12-20T22:17:43.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26582024-12-20T22:17:43.717ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
26592024-12-20T22:17:43.717ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26602024-12-20T22:17:43.717ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6d7897af-0b35-40c0-ae38-a31e0bafb7a0", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
26612024-12-20T22:17:43.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26622024-12-20T22:17:43.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26632024-12-20T22:17:43.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26642024-12-20T22:17:43.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26652024-12-20T22:17:43.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26662024-12-20T22:17:43.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26672024-12-20T22:17:43.726ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26682024-12-20T22:17:43.726ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26692024-12-20T22:17:43.727ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "44557dd8-e8ef-467f-810a-fd2e42b6faeb", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
26702024-12-20T22:17:43.728ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.265012ms iteration = 9 status = {}
26712024-12-20T22:17:43.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa2fd7df-d0eb-4b16-b779-d62c6e658ba9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
26722024-12-20T22:17:43.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa2fd7df-d0eb-4b16-b779-d62c6e658ba9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
26732024-12-20T22:17:43.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26742024-12-20T22:17:43.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26752024-12-20T22:17:43.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa2fd7df-d0eb-4b16-b779-d62c6e658ba9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
26762024-12-20T22:17:43.749ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
26772024-12-20T22:17:43.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26782024-12-20T22:17:43.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26792024-12-20T22:17:43.769ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26802024-12-20T22:17:43.770ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "034e5f30-245d-4907-b0f4-ec71e9ba18c6", "content-length": "134", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
26812024-12-20T22:17:43.770ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26822024-12-20T22:17:43.770ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
26832024-12-20T22:17:43.770ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26842024-12-20T22:17:43.770ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26852024-12-20T22:17:43.770ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26862024-12-20T22:17:43.770ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26872024-12-20T22:17:43.770ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26882024-12-20T22:17:43.770ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26892024-12-20T22:17:43.771ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26902024-12-20T22:17:43.771ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26912024-12-20T22:17:43.771ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
26922024-12-20T22:17:43.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26932024-12-20T22:17:43.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26942024-12-20T22:17:43.775ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26952024-12-20T22:17:43.776ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "25c5af90-8704-4d6d-a7ea-809d0796511a", "content-length": "2", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
26962024-12-20T22:17:43.776ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26972024-12-20T22:17:43.776ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c439d775-e7e1-49ce-90e1-b6fbf0394f1e", "content-length": "52", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
26982024-12-20T22:17:43.776ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
26992024-12-20T22:17:43.776ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27002024-12-20T22:17:43.851ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27012024-12-20T22:17:43.890ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8993f80f-156a-4245-a35b-be40ef67ad20", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
27022024-12-20T22:17:43.891ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
27032024-12-20T22:17:43.891ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27042024-12-20T22:17:43.891ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ad5c287-7c70-4455-86c1-e78f4801a687", "content-length": "691", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
27052024-12-20T22:17:43.891ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
27062024-12-20T22:17:43.891ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
27072024-12-20T22:17:43.891ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
27082024-12-20T22:17:43.891ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "897afc80-2af1-443d-aaba-3eb03e0549c5", "content-length": "682", "date": "Fri, 20 Dec 2024 22:17:43 GMT"} })
27092024-12-20T22:17:43.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27102024-12-20T22:17:43.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27112024-12-20T22:17:43.892ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 452.953779ms iteration = 8 status = {}
27122024-12-20T22:17:43.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27132024-12-20T22:17:43.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27142024-12-20T22:17:43.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27152024-12-20T22:17:43.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27162024-12-20T22:17:43.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27172024-12-20T22:17:43.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27182024-12-20T22:17:43.909ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 469.771048ms iteration = 8 status = {}
27192024-12-20T22:17:44.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = c49f1817-ce9d-4d33-9833-9d79744b5d21 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
27202024-12-20T22:17:44.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = c49f1817-ce9d-4d33-9833-9d79744b5d21 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
27212024-12-20T22:17:44.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = c49f1817-ce9d-4d33-9833-9d79744b5d21 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
27222024-12-20T22:17:44.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b1786229-5bce-4bf9-b230-706b8ac8fdbd roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27232024-12-20T22:17:44.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b1786229-5bce-4bf9-b230-706b8ac8fdbd resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27242024-12-20T22:17:44.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b1786229-5bce-4bf9-b230-706b8ac8fdbd response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27252024-12-20T22:17:45.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1289 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 1c0753c5-2aed-4546-9423-a56ad636819e response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
27262024-12-20T22:17:45.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ea1307ee-10a8-494f-96ff-b009330fc2f2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27272024-12-20T22:17:45.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ea1307ee-10a8-494f-96ff-b009330fc2f2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27282024-12-20T22:17:45.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ea1307ee-10a8-494f-96ff-b009330fc2f2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27292024-12-20T22:17:46.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 816ad982-0e6a-4ec5-b558-7aae37baa951 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27302024-12-20T22:17:46.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 816ad982-0e6a-4ec5-b558-7aae37baa951 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27312024-12-20T22:17:46.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 816ad982-0e6a-4ec5-b558-7aae37baa951 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27322024-12-20T22:17:47.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d8b1e9c1-cef3-47ad-8eec-3abc0b6f5157 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27332024-12-20T22:17:47.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d8b1e9c1-cef3-47ad-8eec-3abc0b6f5157 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27342024-12-20T22:17:47.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d8b1e9c1-cef3-47ad-8eec-3abc0b6f5157 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27352024-12-20T22:17:48.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9983ea48-d1ed-4f13-890a-bcd9ab845f60 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27362024-12-20T22:17:48.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9983ea48-d1ed-4f13-890a-bcd9ab845f60 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27372024-12-20T22:17:48.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9983ea48-d1ed-4f13-890a-bcd9ab845f60 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27382024-12-20T22:17:49.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c68e4acd-8273-48c1-9e10-e16927008bf1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27392024-12-20T22:17:49.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c68e4acd-8273-48c1-9e10-e16927008bf1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27402024-12-20T22:17:49.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c68e4acd-8273-48c1-9e10-e16927008bf1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27412024-12-20T22:17:51.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af9a199f-2e74-4bb0-8e1a-c47bbbea1362 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27422024-12-20T22:17:51.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af9a199f-2e74-4bb0-8e1a-c47bbbea1362 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27432024-12-20T22:17:51.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af9a199f-2e74-4bb0-8e1a-c47bbbea1362 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27442024-12-20T22:17:52.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 58df72cc-16e1-4fd1-83d1-5f835d8733ce roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27452024-12-20T22:17:52.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 58df72cc-16e1-4fd1-83d1-5f835d8733ce resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27462024-12-20T22:17:52.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 58df72cc-16e1-4fd1-83d1-5f835d8733ce response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27472024-12-20T22:17:53.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 77ad9993-9342-45c7-8c00-1a472ce1bedd roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27482024-12-20T22:17:53.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 77ad9993-9342-45c7-8c00-1a472ce1bedd resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27492024-12-20T22:17:53.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 77ad9993-9342-45c7-8c00-1a472ce1bedd response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27502024-12-20T22:17:53.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
27512024-12-20T22:17:53.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
27522024-12-20T22:17:53.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27532024-12-20T22:17:53.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27542024-12-20T22:17:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27552024-12-20T22:17:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27562024-12-20T22:17:53.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27572024-12-20T22:17:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27582024-12-20T22:17:53.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27592024-12-20T22:17:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27602024-12-20T22:17:53.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27612024-12-20T22:17:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27622024-12-20T22:17:53.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27632024-12-20T22:17:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
27642024-12-20T22:17:53.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27652024-12-20T22:17:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27662024-12-20T22:17:53.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
27672024-12-20T22:17:53.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.8895ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
27682024-12-20T22:17:53.474ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27692024-12-20T22:17:53.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27702024-12-20T22:17:53.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.166064ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27712024-12-20T22:17:54.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca54ae37-1e0a-4961-a81d-b3730f632c71 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27722024-12-20T22:17:54.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca54ae37-1e0a-4961-a81d-b3730f632c71 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27732024-12-20T22:17:54.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca54ae37-1e0a-4961-a81d-b3730f632c71 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27742024-12-20T22:17:55.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 049bd3b0-38d8-4eed-8491-96b154d20e26 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27752024-12-20T22:17:55.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 049bd3b0-38d8-4eed-8491-96b154d20e26 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27762024-12-20T22:17:55.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 049bd3b0-38d8-4eed-8491-96b154d20e26 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27772024-12-20T22:17:55.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 383f6b66-a6fe-4fbf-95b7-77bc0c8deacc roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
27782024-12-20T22:17:55.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 383f6b66-a6fe-4fbf-95b7-77bc0c8deacc resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
27792024-12-20T22:17:55.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 383f6b66-a6fe-4fbf-95b7-77bc0c8deacc response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
27802024-12-20T22:17:55.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 4dbd8864-0b66-4371-b3b7-90891e35604b roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
27812024-12-20T22:17:55.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 4dbd8864-0b66-4371-b3b7-90891e35604b resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
27822024-12-20T22:17:55.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 4dbd8864-0b66-4371-b3b7-90891e35604b response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
27832024-12-20T22:17:55.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1455 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 12128278-102a-4f91-a021-e1f893a88c8e response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
27842024-12-20T22:17:56.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d9e54f8e-a82a-4bef-b7ff-ad7079ff0532 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27852024-12-20T22:17:56.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d9e54f8e-a82a-4bef-b7ff-ad7079ff0532 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27862024-12-20T22:17:56.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d9e54f8e-a82a-4bef-b7ff-ad7079ff0532 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27872024-12-20T22:17:57.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8f95eaca-438c-4389-b823-08e746be6f62 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27882024-12-20T22:17:57.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8f95eaca-438c-4389-b823-08e746be6f62 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27892024-12-20T22:17:57.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8f95eaca-438c-4389-b823-08e746be6f62 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27902024-12-20T22:17:58.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 24b6335e-0c35-4ca6-958b-d34cff7c606e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27912024-12-20T22:17:58.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 24b6335e-0c35-4ca6-958b-d34cff7c606e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27922024-12-20T22:17:58.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 24b6335e-0c35-4ca6-958b-d34cff7c606e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27932024-12-20T22:17:59.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3882f9f-7c86-4d05-82ba-0cc4ff0ec018 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27942024-12-20T22:17:59.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3882f9f-7c86-4d05-82ba-0cc4ff0ec018 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27952024-12-20T22:17:59.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3882f9f-7c86-4d05-82ba-0cc4ff0ec018 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27962024-12-20T22:18:00.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2dda3602-f563-4d2f-baf8-98fc53629596 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27972024-12-20T22:18:00.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2dda3602-f563-4d2f-baf8-98fc53629596 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27982024-12-20T22:18:00.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2dda3602-f563-4d2f-baf8-98fc53629596 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
27992024-12-20T22:18:01.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c1755940-47b7-4274-a1f4-95f424271ea9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28002024-12-20T22:18:01.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c1755940-47b7-4274-a1f4-95f424271ea9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28012024-12-20T22:18:01.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c1755940-47b7-4274-a1f4-95f424271ea9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28022024-12-20T22:18:02.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b3bd4591-407b-49c7-8679-ee08daf3c15b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28032024-12-20T22:18:02.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b3bd4591-407b-49c7-8679-ee08daf3c15b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28042024-12-20T22:18:02.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b3bd4591-407b-49c7-8679-ee08daf3c15b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28052024-12-20T22:18:03.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dde2e158-eae3-46bb-a87e-e2159575d6c5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28062024-12-20T22:18:03.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dde2e158-eae3-46bb-a87e-e2159575d6c5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28072024-12-20T22:18:03.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dde2e158-eae3-46bb-a87e-e2159575d6c5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28082024-12-20T22:18:03.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
28092024-12-20T22:18:03.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
28102024-12-20T22:18:03.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28112024-12-20T22:18:03.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28122024-12-20T22:18:03.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28132024-12-20T22:18:03.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28142024-12-20T22:18:03.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28152024-12-20T22:18:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28162024-12-20T22:18:03.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28172024-12-20T22:18:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28182024-12-20T22:18:03.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28192024-12-20T22:18:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28202024-12-20T22:18:03.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28212024-12-20T22:18:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
28222024-12-20T22:18:03.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28232024-12-20T22:18:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28242024-12-20T22:18:03.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
28252024-12-20T22:18:03.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.657028ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
28262024-12-20T22:18:03.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28272024-12-20T22:18:03.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28282024-12-20T22:18:03.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.020802ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28292024-12-20T22:18:04.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cbf14040-69bd-4a9a-b921-b853a85fa62b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28302024-12-20T22:18:04.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cbf14040-69bd-4a9a-b921-b853a85fa62b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28312024-12-20T22:18:04.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cbf14040-69bd-4a9a-b921-b853a85fa62b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28322024-12-20T22:18:05.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 07c98f9b-230e-4a8e-8568-595bae46d8c5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28332024-12-20T22:18:05.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 07c98f9b-230e-4a8e-8568-595bae46d8c5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28342024-12-20T22:18:05.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 07c98f9b-230e-4a8e-8568-595bae46d8c5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28352024-12-20T22:18:05.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1396 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 9c0c982c-451f-48cd-aa88-e226c12732f9 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
28362024-12-20T22:18:06.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f14672c-5fae-4de5-a5a7-bfcc8bba60c0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28372024-12-20T22:18:06.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f14672c-5fae-4de5-a5a7-bfcc8bba60c0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28382024-12-20T22:18:06.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f14672c-5fae-4de5-a5a7-bfcc8bba60c0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28392024-12-20T22:18:07.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0a51acaa-536b-4a81-be90-103e32092d27 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28402024-12-20T22:18:07.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0a51acaa-536b-4a81-be90-103e32092d27 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28412024-12-20T22:18:07.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0a51acaa-536b-4a81-be90-103e32092d27 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28422024-12-20T22:18:08.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 436d82ec-9190-4a13-9a0e-f7d3cdd0734c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28432024-12-20T22:18:08.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 436d82ec-9190-4a13-9a0e-f7d3cdd0734c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28442024-12-20T22:18:08.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 436d82ec-9190-4a13-9a0e-f7d3cdd0734c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28452024-12-20T22:18:09.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bb47fbab-65bf-448c-a2b1-c4dc6f6b66f3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28462024-12-20T22:18:09.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bb47fbab-65bf-448c-a2b1-c4dc6f6b66f3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28472024-12-20T22:18:09.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bb47fbab-65bf-448c-a2b1-c4dc6f6b66f3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28482024-12-20T22:18:10.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 466f002e-d022-46ad-9341-3c8c9ae8f459 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28492024-12-20T22:18:10.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 466f002e-d022-46ad-9341-3c8c9ae8f459 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28502024-12-20T22:18:10.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 466f002e-d022-46ad-9341-3c8c9ae8f459 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28512024-12-20T22:18:10.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d31ce4ea-92ef-4f22-adfc-5568a7179622 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
28522024-12-20T22:18:10.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d31ce4ea-92ef-4f22-adfc-5568a7179622 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
28532024-12-20T22:18:10.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d31ce4ea-92ef-4f22-adfc-5568a7179622 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
28542024-12-20T22:18:10.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 73141736-72c0-4489-aa57-49ce7c661d09 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
28552024-12-20T22:18:10.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 73141736-72c0-4489-aa57-49ce7c661d09 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
28562024-12-20T22:18:10.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 73141736-72c0-4489-aa57-49ce7c661d09 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
28572024-12-20T22:18:11.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b555c5-a8d6-4c3a-9c9e-c8b2dbd63f27 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28582024-12-20T22:18:11.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b555c5-a8d6-4c3a-9c9e-c8b2dbd63f27 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28592024-12-20T22:18:11.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b555c5-a8d6-4c3a-9c9e-c8b2dbd63f27 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28602024-12-20T22:18:12.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 91f1a9fb-5c13-499c-beda-90c433816ae6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28612024-12-20T22:18:12.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 91f1a9fb-5c13-499c-beda-90c433816ae6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28622024-12-20T22:18:12.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 91f1a9fb-5c13-499c-beda-90c433816ae6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
28632024-12-20T22:18:13.440ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
28642024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
28652024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28662024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
28672024-12-20T22:18:13.441ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28682024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
28692024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28702024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28712024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
28722024-12-20T22:18:13.441ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:08:13.440998580 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
28732024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
28742024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
28752024-12-20T22:18:13.441ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
28762024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
28772024-12-20T22:18:13.441ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
28782024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 26.07\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
28792024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
28802024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
28812024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28822024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28832024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28842024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
28852024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
28862024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28872024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
28882024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
28892024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28902024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28912024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
28922024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
28932024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28942024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
28952024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
28962024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28972024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
28982024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28992024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
29002024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
29012024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29022024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
29032024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29042024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29052024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
29062024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
29072024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
29082024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29092024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29102024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
29112024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
29122024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
29132024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29142024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29152024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
29162024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
29172024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29182024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29192024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
29202024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
29212024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
29222024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
29232024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
29242024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29252024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
29262024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29272024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29282024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29292024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29302024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29312024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29322024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29332024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29342024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29352024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
29362024-12-20T22:18:13.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29372024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29382024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29392024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29402024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29412024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29422024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29432024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29442024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29452024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29462024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
29472024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29482024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29492024-12-20T22:18:13.442ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1120, tv_nsec: 371639980 } })
29502024-12-20T22:18:13.442ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1120, tv_nsec: 371854592 } })
29512024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
29522024-12-20T22:18:13.442ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.439835ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
29532024-12-20T22:18:13.443ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
29542024-12-20T22:18:13.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.901549ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
29552024-12-20T22:18:13.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29562024-12-20T22:18:13.444ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.870689ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29572024-12-20T22:18:13.445ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29582024-12-20T22:18:13.445ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29592024-12-20T22:18:13.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29602024-12-20T22:18:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29612024-12-20T22:18:13.446ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1120, tv_nsec: 375754081 } })
29622024-12-20T22:18:13.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
29632024-12-20T22:18:13.446ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:08:13.440998580 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
29642024-12-20T22:18:13.446ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.731897ms iteration = 5 status = {"expiration":"2024-12-20T22:08:13.440998580Z","pruned":[]}
29652024-12-20T22:18:13.446ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1120, tv_nsec: 376395418 } })
29662024-12-20T22:18:13.447ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
29672024-12-20T22:18:13.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29682024-12-20T22:18:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
29692024-12-20T22:18:13.447ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29702024-12-20T22:18:13.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29712024-12-20T22:18:13.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29722024-12-20T22:18:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29732024-12-20T22:18:13.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29742024-12-20T22:18:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29752024-12-20T22:18:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29762024-12-20T22:18:13.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29772024-12-20T22:18:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29782024-12-20T22:18:13.453ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29792024-12-20T22:18:13.453ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29802024-12-20T22:18:13.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29812024-12-20T22:18:13.453ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
29822024-12-20T22:18:13.453ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
29832024-12-20T22:18:13.453ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.164212ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
29842024-12-20T22:18:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29852024-12-20T22:18:13.454ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29862024-12-20T22:18:13.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29872024-12-20T22:18:13.455ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29882024-12-20T22:18:13.456ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29892024-12-20T22:18:13.457ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29902024-12-20T22:18:13.457ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29912024-12-20T22:18:13.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29922024-12-20T22:18:13.457ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29932024-12-20T22:18:13.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29942024-12-20T22:18:13.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29952024-12-20T22:18:13.458ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29962024-12-20T22:18:13.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29972024-12-20T22:18:13.459ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29982024-12-20T22:18:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29992024-12-20T22:18:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30002024-12-20T22:18:13.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30012024-12-20T22:18:13.460ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.008151ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
30022024-12-20T22:18:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30032024-12-20T22:18:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30042024-12-20T22:18:13.460ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30052024-12-20T22:18:13.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30062024-12-20T22:18:13.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30072024-12-20T22:18:13.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30082024-12-20T22:18:13.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30092024-12-20T22:18:13.469ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30102024-12-20T22:18:13.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30112024-12-20T22:18:13.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30122024-12-20T22:18:13.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30132024-12-20T22:18:13.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30142024-12-20T22:18:13.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30152024-12-20T22:18:13.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30162024-12-20T22:18:13.474ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.614859ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30172024-12-20T22:18:13.482ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30182024-12-20T22:18:13.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30192024-12-20T22:18:13.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5029cde0-25e3-4be6-acbe-d2820f633688 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
30202024-12-20T22:18:13.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5029cde0-25e3-4be6-acbe-d2820f633688 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
30212024-12-20T22:18:13.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30222024-12-20T22:18:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30232024-12-20T22:18:13.523ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.753933ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30242024-12-20T22:18:13.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.35471ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30252024-12-20T22:18:13.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.035877ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
30262024-12-20T22:18:13.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5029cde0-25e3-4be6-acbe-d2820f633688 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
30272024-12-20T22:18:13.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 94.079517ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
30282024-12-20T22:18:13.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30292024-12-20T22:18:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30302024-12-20T22:18:13.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30312024-12-20T22:18:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30322024-12-20T22:18:13.543ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
30332024-12-20T22:18:13.543ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
30342024-12-20T22:18:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.369ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
30352024-12-20T22:18:13.544ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30362024-12-20T22:18:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30372024-12-20T22:18:13.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30382024-12-20T22:18:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30392024-12-20T22:18:13.551ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30402024-12-20T22:18:13.551ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30412024-12-20T22:18:13.551ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30422024-12-20T22:18:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30432024-12-20T22:18:13.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30442024-12-20T22:18:13.551ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30452024-12-20T22:18:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30462024-12-20T22:18:13.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30472024-12-20T22:18:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30482024-12-20T22:18:13.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30492024-12-20T22:18:13.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30502024-12-20T22:18:13.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30512024-12-20T22:18:13.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30522024-12-20T22:18:13.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30532024-12-20T22:18:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30542024-12-20T22:18:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
30552024-12-20T22:18:13.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30562024-12-20T22:18:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30572024-12-20T22:18:13.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30582024-12-20T22:18:13.565ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1120, tv_nsec: 494520547 } })
30592024-12-20T22:18:13.565ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
30602024-12-20T22:18:13.565ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30612024-12-20T22:18:13.565ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30622024-12-20T22:18:13.566ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "149b36b5-1d4c-4045-ba35-e9d78c5d2dba", "content-length": "26", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} })
30632024-12-20T22:18:13.566ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30642024-12-20T22:18:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30652024-12-20T22:18:13.567ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30662024-12-20T22:18:13.568ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30672024-12-20T22:18:13.568ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30682024-12-20T22:18:13.568ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30692024-12-20T22:18:13.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30702024-12-20T22:18:13.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30712024-12-20T22:18:13.568ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 127.790647ms iteration = 9 status = 0
30722024-12-20T22:18:13.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30732024-12-20T22:18:13.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30742024-12-20T22:18:13.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30752024-12-20T22:18:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
30762024-12-20T22:18:13.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30772024-12-20T22:18:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30782024-12-20T22:18:13.582ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30792024-12-20T22:18:13.584ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30802024-12-20T22:18:13.584ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 142.869837ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30812024-12-20T22:18:13.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30822024-12-20T22:18:13.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30832024-12-20T22:18:13.586ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
30842024-12-20T22:18:13.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
30852024-12-20T22:18:13.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30862024-12-20T22:18:13.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30872024-12-20T22:18:13.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30882024-12-20T22:18:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30892024-12-20T22:18:13.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
30902024-12-20T22:18:13.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 154.429164ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
30912024-12-20T22:18:13.598ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
30922024-12-20T22:18:13.598ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
30932024-12-20T22:18:13.598ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
30942024-12-20T22:18:13.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30952024-12-20T22:18:13.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30962024-12-20T22:18:13.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30972024-12-20T22:18:13.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30982024-12-20T22:18:13.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30992024-12-20T22:18:13.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31002024-12-20T22:18:13.607ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 166.00809ms iteration = 12 status = {"physical_disks_added":0}
31012024-12-20T22:18:13.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 167.528776ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
31022024-12-20T22:18:13.609ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31032024-12-20T22:18:13.609ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31042024-12-20T22:18:13.609ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee9531ac-3e77-4dfd-b13b-54e423cc59aa", "content-length": "26", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} })
31052024-12-20T22:18:13.609ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31062024-12-20T22:18:13.611ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31072024-12-20T22:18:13.614ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31082024-12-20T22:18:13.615ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31092024-12-20T22:18:13.615ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 172.062602ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31102024-12-20T22:18:13.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31112024-12-20T22:18:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31122024-12-20T22:18:13.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31132024-12-20T22:18:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31142024-12-20T22:18:13.637ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31152024-12-20T22:18:13.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31162024-12-20T22:18:13.639ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31172024-12-20T22:18:13.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31182024-12-20T22:18:13.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31192024-12-20T22:18:13.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31202024-12-20T22:18:13.648ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
31212024-12-20T22:18:13.648ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
31222024-12-20T22:18:13.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31232024-12-20T22:18:13.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31242024-12-20T22:18:13.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31252024-12-20T22:18:13.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31262024-12-20T22:18:13.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31272024-12-20T22:18:13.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31282024-12-20T22:18:13.657ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
31292024-12-20T22:18:13.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31302024-12-20T22:18:13.658ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
31312024-12-20T22:18:13.658ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
31322024-12-20T22:18:13.658ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
31332024-12-20T22:18:13.658ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 216.975124ms iteration = 6 status = {"generation":1}
31342024-12-20T22:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31352024-12-20T22:18:13.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31362024-12-20T22:18:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31372024-12-20T22:18:13.669ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
31382024-12-20T22:18:13.669ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
31392024-12-20T22:18:13.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31402024-12-20T22:18:13.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31412024-12-20T22:18:13.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31422024-12-20T22:18:13.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31432024-12-20T22:18:13.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31442024-12-20T22:18:13.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31452024-12-20T22:18:13.725ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31462024-12-20T22:18:13.725ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 283.813446ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31472024-12-20T22:18:13.749ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
31482024-12-20T22:18:13.752ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c2ce4f1e-c2f3-4d88-81bf-38ee2c51eb95", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31492024-12-20T22:18:13.752ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31502024-12-20T22:18:13.754ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "43e9f549-0531-4fd1-8929-91a10bdc130d", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31512024-12-20T22:18:13.754ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31522024-12-20T22:18:13.756ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31532024-12-20T22:18:13.756ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 315.095641ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
31542024-12-20T22:18:13.770ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 329.673748ms iteration = 9 status = {}
31552024-12-20T22:18:13.781ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31562024-12-20T22:18:13.782ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31572024-12-20T22:18:13.782ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e40135f0-bd36-4391-a4fd-6c9cd6a7fb5c", "content-length": "372", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} })
31582024-12-20T22:18:13.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31592024-12-20T22:18:13.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31602024-12-20T22:18:13.786ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31612024-12-20T22:18:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31622024-12-20T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31632024-12-20T22:18:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31642024-12-20T22:18:13.793ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
31652024-12-20T22:18:13.793ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
31662024-12-20T22:18:13.793ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
31672024-12-20T22:18:13.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 352.247346ms iteration = 6 status = {"generation":2}
31682024-12-20T22:18:13.805ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31692024-12-20T22:18:13.806ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b4d1baa-cf73-4f13-a446-66c40f378e32", "content-length": "1", "date": "Fri, 20 Dec 2024 22:18:12 GMT"} })
31702024-12-20T22:18:13.808ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31712024-12-20T22:18:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31722024-12-20T22:18:13.811ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 370.151736ms iteration = 9 status = null
31732024-12-20T22:18:13.836ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
31742024-12-20T22:18:13.836ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31752024-12-20T22:18:13.836ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bd30465-59c4-4b6b-917e-bb602ba14208", "content-length": "26", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} })
31762024-12-20T22:18:13.836ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31772024-12-20T22:18:13.839ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
31782024-12-20T22:18:13.845ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
31792024-12-20T22:18:13.845ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 404.565612ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31802024-12-20T22:18:13.852ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
31812024-12-20T22:18:13.852ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31822024-12-20T22:18:13.852ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
31832024-12-20T22:18:13.852ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b38ffe9f-dc41-4f41-84d0-97898e3e6a36", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} })
31842024-12-20T22:18:13.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31852024-12-20T22:18:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31862024-12-20T22:18:13.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31872024-12-20T22:18:13.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31882024-12-20T22:18:13.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31892024-12-20T22:18:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31902024-12-20T22:18:13.862ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31912024-12-20T22:18:13.862ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31922024-12-20T22:18:13.862ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "93ae1364-1f7d-4374-ab99-1d65f041dc22", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} })
31932024-12-20T22:18:13.864ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 423.372731ms iteration = 10 status = {}
31942024-12-20T22:18:13.924ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
31952024-12-20T22:18:13.924ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "29242cc7-4510-4bbb-aae4-a6666779016a", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
31962024-12-20T22:18:13.924ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
31972024-12-20T22:18:13.926ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1af2b27d-11b9-4035-93e6-39f8ee44856f", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
31982024-12-20T22:18:13.926ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
31992024-12-20T22:18:13.928ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a1fd6274-2667-4c9f-8d8a-dc6a077e13bc", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32002024-12-20T22:18:13.928ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32012024-12-20T22:18:13.930ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32022024-12-20T22:18:13.930ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 489.271714ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32032024-12-20T22:18:13.944ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32042024-12-20T22:18:13.944ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0d52ddc-aa22-49a5-98b7-cced466bf7a8", "content-length": "691", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} })
32052024-12-20T22:18:13.945ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
32062024-12-20T22:18:13.945ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
32072024-12-20T22:18:13.945ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
32082024-12-20T22:18:13.945ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 504.902321ms iteration = 9 status = {}
32092024-12-20T22:18:14.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32102024-12-20T22:18:14.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32112024-12-20T22:18:14.022ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
32122024-12-20T22:18:14.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32132024-12-20T22:18:14.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32142024-12-20T22:18:14.034ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32152024-12-20T22:18:14.035ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d273636-2907-4e76-9f87-5236dcc03131", "content-length": "134", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} })
32162024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32172024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
32182024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32192024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32202024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32212024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32222024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32232024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32242024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32252024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32262024-12-20T22:18:14.035ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
32272024-12-20T22:18:14.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32282024-12-20T22:18:14.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32292024-12-20T22:18:14.038ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32302024-12-20T22:18:14.038ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d83dd2d-9a2b-47d0-8290-f8b65a7ca692", "content-length": "2", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} })
32312024-12-20T22:18:14.038ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32322024-12-20T22:18:14.038ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "082c94ce-11fd-450f-8cba-1fcb2fc1370c", "content-length": "52", "date": "Fri, 20 Dec 2024 22:18:13 GMT"} })
32332024-12-20T22:18:14.038ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
32342024-12-20T22:18:14.038ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32352024-12-20T22:18:14.220ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cc1899b1-80d4-48d1-9b36-1a899db7a45d", "date": "Fri, 20 Dec 2024 22:18:14 GMT"} })
32362024-12-20T22:18:14.221ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
32372024-12-20T22:18:14.221ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32382024-12-20T22:18:14.221ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fed352f-be8e-4f9e-97c3-96fd93b13fd3", "content-length": "682", "date": "Fri, 20 Dec 2024 22:18:14 GMT"} })
32392024-12-20T22:18:14.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32402024-12-20T22:18:14.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32412024-12-20T22:18:14.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32422024-12-20T22:18:14.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32432024-12-20T22:18:14.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32442024-12-20T22:18:14.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32452024-12-20T22:18:14.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32462024-12-20T22:18:14.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32472024-12-20T22:18:14.238ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 797.668297ms iteration = 9 status = {}
32482024-12-20T22:18:14.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ce2ee004-5cf3-4811-8392-015d0ce3bcc1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32492024-12-20T22:18:14.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ce2ee004-5cf3-4811-8392-015d0ce3bcc1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32502024-12-20T22:18:14.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ce2ee004-5cf3-4811-8392-015d0ce3bcc1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32512024-12-20T22:18:14.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9b8b7be6-48ed-4e1c-b2fc-03a89abb661d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32522024-12-20T22:18:14.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9b8b7be6-48ed-4e1c-b2fc-03a89abb661d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32532024-12-20T22:18:14.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9b8b7be6-48ed-4e1c-b2fc-03a89abb661d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32542024-12-20T22:18:15.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6dcf1ca0-f96b-4a51-9af7-97abd5cf1008 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32552024-12-20T22:18:15.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6dcf1ca0-f96b-4a51-9af7-97abd5cf1008 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32562024-12-20T22:18:15.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6dcf1ca0-f96b-4a51-9af7-97abd5cf1008 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32572024-12-20T22:18:15.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1453 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = ceb1bbf5-cb66-4cca-adad-d9125060514d response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
32582024-12-20T22:18:16.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b1ae4577-e130-4a4a-b1f7-33abd53526b2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32592024-12-20T22:18:16.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b1ae4577-e130-4a4a-b1f7-33abd53526b2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32602024-12-20T22:18:16.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b1ae4577-e130-4a4a-b1f7-33abd53526b2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32612024-12-20T22:18:17.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2fe520e-ae6c-4a49-9a45-40719e951833 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32622024-12-20T22:18:17.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2fe520e-ae6c-4a49-9a45-40719e951833 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32632024-12-20T22:18:17.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2fe520e-ae6c-4a49-9a45-40719e951833 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32642024-12-20T22:18:18.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 615ed091-1222-462c-a692-557cf6e4972d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32652024-12-20T22:18:18.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 615ed091-1222-462c-a692-557cf6e4972d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32662024-12-20T22:18:18.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 615ed091-1222-462c-a692-557cf6e4972d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32672024-12-20T22:18:19.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 146a4f45-5a04-4e1f-9cd1-8c5fb442ff4b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32682024-12-20T22:18:19.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 146a4f45-5a04-4e1f-9cd1-8c5fb442ff4b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32692024-12-20T22:18:19.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 146a4f45-5a04-4e1f-9cd1-8c5fb442ff4b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32702024-12-20T22:18:20.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1ce3f031-9d2a-4a03-9870-288ccb24a928 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32712024-12-20T22:18:20.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1ce3f031-9d2a-4a03-9870-288ccb24a928 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32722024-12-20T22:18:20.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1ce3f031-9d2a-4a03-9870-288ccb24a928 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32732024-12-20T22:18:21.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d3e0a32-7596-4a27-b5e5-12bdde6bd740 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32742024-12-20T22:18:21.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d3e0a32-7596-4a27-b5e5-12bdde6bd740 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32752024-12-20T22:18:21.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d3e0a32-7596-4a27-b5e5-12bdde6bd740 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32762024-12-20T22:18:22.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d0849aed-8004-4674-ab06-e9cd46106de1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32772024-12-20T22:18:22.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d0849aed-8004-4674-ab06-e9cd46106de1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32782024-12-20T22:18:22.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d0849aed-8004-4674-ab06-e9cd46106de1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
32792024-12-20T22:18:23.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
32802024-12-20T22:18:23.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
32812024-12-20T22:18:23.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32822024-12-20T22:18:23.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32832024-12-20T22:18:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32842024-12-20T22:18:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32852024-12-20T22:18:23.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32862024-12-20T22:18:23.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32872024-12-20T22:18:23.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32882024-12-20T22:18:23.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32892024-12-20T22:18:23.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32902024-12-20T22:18:23.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32912024-12-20T22:18:23.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32922024-12-20T22:18:23.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32932024-12-20T22:18:23.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.069074ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32942024-12-20T22:18:23.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32952024-12-20T22:18:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
32962024-12-20T22:18:23.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32972024-12-20T22:18:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32982024-12-20T22:18:23.522ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
32992024-12-20T22:18:23.522ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.313749ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
33002024-12-20T22:18:23.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e9b1d41b-b5a7-48aa-a06a-ab44dfbff427 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33012024-12-20T22:18:23.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e9b1d41b-b5a7-48aa-a06a-ab44dfbff427 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33022024-12-20T22:18:23.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e9b1d41b-b5a7-48aa-a06a-ab44dfbff427 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33032024-12-20T22:18:24.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d964533-6db5-497c-a570-e346d8414721 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33042024-12-20T22:18:24.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d964533-6db5-497c-a570-e346d8414721 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33052024-12-20T22:18:24.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d964533-6db5-497c-a570-e346d8414721 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33062024-12-20T22:18:25.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 44098211-df6d-4c08-85c7-fe4c65734ef1 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
33072024-12-20T22:18:25.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 44098211-df6d-4c08-85c7-fe4c65734ef1 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
33082024-12-20T22:18:25.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 44098211-df6d-4c08-85c7-fe4c65734ef1 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
33092024-12-20T22:18:25.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 81e6e83b-069a-42bd-980f-5737dfea9de1 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
33102024-12-20T22:18:25.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 81e6e83b-069a-42bd-980f-5737dfea9de1 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
33112024-12-20T22:18:25.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 81e6e83b-069a-42bd-980f-5737dfea9de1 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
33122024-12-20T22:18:25.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1617 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 4ed04481-c56a-47af-872b-f85eeae8a648 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
33132024-12-20T22:18:25.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3c11ab95-f59c-4e8a-a13e-d0315f45f750 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33142024-12-20T22:18:25.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3c11ab95-f59c-4e8a-a13e-d0315f45f750 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33152024-12-20T22:18:25.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3c11ab95-f59c-4e8a-a13e-d0315f45f750 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33162024-12-20T22:18:26.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1b40a74d-bad1-4fdc-87aa-1d3a55a2502f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33172024-12-20T22:18:26.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1b40a74d-bad1-4fdc-87aa-1d3a55a2502f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33182024-12-20T22:18:26.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1b40a74d-bad1-4fdc-87aa-1d3a55a2502f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33192024-12-20T22:18:27.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81cac3ff-b933-4c34-9fac-8321a470e7b6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33202024-12-20T22:18:27.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81cac3ff-b933-4c34-9fac-8321a470e7b6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33212024-12-20T22:18:27.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81cac3ff-b933-4c34-9fac-8321a470e7b6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33222024-12-20T22:18:28.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7ac857d0-f1c0-4b2e-9966-876a99f7f35a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33232024-12-20T22:18:28.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7ac857d0-f1c0-4b2e-9966-876a99f7f35a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33242024-12-20T22:18:28.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7ac857d0-f1c0-4b2e-9966-876a99f7f35a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33252024-12-20T22:18:29.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e100e7f4-2171-445c-8b29-78051c5b3f98 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33262024-12-20T22:18:29.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e100e7f4-2171-445c-8b29-78051c5b3f98 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33272024-12-20T22:18:29.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e100e7f4-2171-445c-8b29-78051c5b3f98 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33282024-12-20T22:18:30.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9005ac56-e259-44c9-8389-74955dc77436 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33292024-12-20T22:18:30.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9005ac56-e259-44c9-8389-74955dc77436 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33302024-12-20T22:18:30.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9005ac56-e259-44c9-8389-74955dc77436 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33312024-12-20T22:18:31.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5b55d78e-dddf-48a7-a873-eb6d6561ec92 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33322024-12-20T22:18:31.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5b55d78e-dddf-48a7-a873-eb6d6561ec92 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33332024-12-20T22:18:31.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5b55d78e-dddf-48a7-a873-eb6d6561ec92 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33342024-12-20T22:18:32.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63fc5f0b-ae23-4914-959b-d7d691bd87e8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33352024-12-20T22:18:32.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63fc5f0b-ae23-4914-959b-d7d691bd87e8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33362024-12-20T22:18:32.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63fc5f0b-ae23-4914-959b-d7d691bd87e8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33372024-12-20T22:18:33.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
33382024-12-20T22:18:33.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
33392024-12-20T22:18:33.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33402024-12-20T22:18:33.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33412024-12-20T22:18:33.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33422024-12-20T22:18:33.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33432024-12-20T22:18:33.470ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33442024-12-20T22:18:33.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33452024-12-20T22:18:33.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33462024-12-20T22:18:33.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33472024-12-20T22:18:33.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33482024-12-20T22:18:33.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33492024-12-20T22:18:33.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33502024-12-20T22:18:33.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33512024-12-20T22:18:33.509ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.139856ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33522024-12-20T22:18:33.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33532024-12-20T22:18:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
33542024-12-20T22:18:33.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33552024-12-20T22:18:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33562024-12-20T22:18:33.528ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
33572024-12-20T22:18:33.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.864925ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
33582024-12-20T22:18:33.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0b6b3590-c1b6-4268-865c-82033a461953 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33592024-12-20T22:18:33.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0b6b3590-c1b6-4268-865c-82033a461953 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33602024-12-20T22:18:33.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0b6b3590-c1b6-4268-865c-82033a461953 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33612024-12-20T22:18:34.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8765929b-9ed8-4066-bd6b-2bee5d428a9b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33622024-12-20T22:18:34.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8765929b-9ed8-4066-bd6b-2bee5d428a9b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33632024-12-20T22:18:34.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8765929b-9ed8-4066-bd6b-2bee5d428a9b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33642024-12-20T22:18:35.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1414 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 62495e11-f36a-4378-84da-94f94bca1c6a response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
33652024-12-20T22:18:36.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 857c7aad-e92b-4afc-b192-fc8ab4838363 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33662024-12-20T22:18:36.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 857c7aad-e92b-4afc-b192-fc8ab4838363 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33672024-12-20T22:18:36.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 857c7aad-e92b-4afc-b192-fc8ab4838363 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33682024-12-20T22:18:37.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 880178c8-411c-48d3-9e9c-a979448fccb0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33692024-12-20T22:18:37.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 880178c8-411c-48d3-9e9c-a979448fccb0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33702024-12-20T22:18:37.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 880178c8-411c-48d3-9e9c-a979448fccb0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33712024-12-20T22:18:38.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5dae35e6-ae6b-49ac-b885-363d4c687d8d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33722024-12-20T22:18:38.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5dae35e6-ae6b-49ac-b885-363d4c687d8d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33732024-12-20T22:18:38.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5dae35e6-ae6b-49ac-b885-363d4c687d8d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33742024-12-20T22:18:39.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7d9b2001-60ae-42a4-98d5-84cbce79a806 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33752024-12-20T22:18:39.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7d9b2001-60ae-42a4-98d5-84cbce79a806 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33762024-12-20T22:18:39.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7d9b2001-60ae-42a4-98d5-84cbce79a806 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33772024-12-20T22:18:40.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9fef0186-031c-47b9-b539-434dfc76baea roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33782024-12-20T22:18:40.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9fef0186-031c-47b9-b539-434dfc76baea resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33792024-12-20T22:18:40.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9fef0186-031c-47b9-b539-434dfc76baea response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33802024-12-20T22:18:40.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 268f9de2-1ee9-46cd-a5f1-1488299f69c3 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
33812024-12-20T22:18:40.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 268f9de2-1ee9-46cd-a5f1-1488299f69c3 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
33822024-12-20T22:18:40.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 268f9de2-1ee9-46cd-a5f1-1488299f69c3 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
33832024-12-20T22:18:40.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 7e8ec3e6-aac5-44e4-bc6a-9206922a3d4f roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
33842024-12-20T22:18:40.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 7e8ec3e6-aac5-44e4-bc6a-9206922a3d4f resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
33852024-12-20T22:18:40.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 7e8ec3e6-aac5-44e4-bc6a-9206922a3d4f response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
33862024-12-20T22:18:41.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f8da04fb-e8a2-41eb-9ae8-c59003ba26c7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33872024-12-20T22:18:41.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f8da04fb-e8a2-41eb-9ae8-c59003ba26c7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33882024-12-20T22:18:41.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f8da04fb-e8a2-41eb-9ae8-c59003ba26c7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33892024-12-20T22:18:42.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35111807-f75d-477e-81fb-2a8638e8db3a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33902024-12-20T22:18:42.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35111807-f75d-477e-81fb-2a8638e8db3a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33912024-12-20T22:18:42.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35111807-f75d-477e-81fb-2a8638e8db3a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33922024-12-20T22:18:43.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 074d21cc-1d88-451f-9090-5269822d4b3a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33932024-12-20T22:18:43.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 074d21cc-1d88-451f-9090-5269822d4b3a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33942024-12-20T22:18:43.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 074d21cc-1d88-451f-9090-5269822d4b3a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
33952024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
33962024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
33972024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33982024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
33992024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34002024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34012024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
34022024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34032024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
34042024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34052024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
34062024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
34072024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34082024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
34092024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
34102024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34112024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
34122024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34132024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34142024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
34152024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34162024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34172024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
34182024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34192024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
34202024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34212024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
34222024-12-20T22:18:43.441ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34232024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34242024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
34252024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34262024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
34272024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34282024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
34292024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34302024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34312024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34322024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34332024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34342024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34352024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34362024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34372024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34382024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34392024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34402024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34412024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34422024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34432024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34442024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34452024-12-20T22:18:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34462024-12-20T22:18:43.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34472024-12-20T22:18:43.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1150, tv_nsec: 373736151 } })
34482024-12-20T22:18:43.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34492024-12-20T22:18:43.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
34502024-12-20T22:18:43.445ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.00857ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34512024-12-20T22:18:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34522024-12-20T22:18:43.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34532024-12-20T22:18:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34542024-12-20T22:18:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34552024-12-20T22:18:43.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34562024-12-20T22:18:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34572024-12-20T22:18:43.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1150, tv_nsec: 379938553 } })
34582024-12-20T22:18:43.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
34592024-12-20T22:18:43.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34602024-12-20T22:18:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34612024-12-20T22:18:43.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34622024-12-20T22:18:43.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34632024-12-20T22:18:43.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.763332ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
34642024-12-20T22:18:43.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34652024-12-20T22:18:43.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34662024-12-20T22:18:43.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34672024-12-20T22:18:43.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34682024-12-20T22:18:43.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34692024-12-20T22:18:43.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34702024-12-20T22:18:43.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34712024-12-20T22:18:43.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34722024-12-20T22:18:43.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34732024-12-20T22:18:43.511ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1150, tv_nsec: 441069319 } })
34742024-12-20T22:18:43.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34752024-12-20T22:18:43.512ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
34762024-12-20T22:18:43.512ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34772024-12-20T22:18:43.512ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34782024-12-20T22:18:43.513ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7687f548-fc5e-4cc9-8b32-281e4cc77234", "content-length": "26", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
34792024-12-20T22:18:43.513ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34802024-12-20T22:18:43.513ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34812024-12-20T22:18:43.513ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34822024-12-20T22:18:43.513ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34832024-12-20T22:18:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34842024-12-20T22:18:43.514ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34852024-12-20T22:18:43.515ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34862024-12-20T22:18:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34872024-12-20T22:18:43.516ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34882024-12-20T22:18:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34892024-12-20T22:18:43.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34902024-12-20T22:18:43.517ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34912024-12-20T22:18:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34922024-12-20T22:18:43.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34932024-12-20T22:18:43.520ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.774253ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
34942024-12-20T22:18:43.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34952024-12-20T22:18:43.521ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34962024-12-20T22:18:43.521ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.376089ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34972024-12-20T22:18:43.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34982024-12-20T22:18:43.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34992024-12-20T22:18:43.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35002024-12-20T22:18:43.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35012024-12-20T22:18:43.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35022024-12-20T22:18:43.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35032024-12-20T22:18:43.525ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35042024-12-20T22:18:43.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35052024-12-20T22:18:43.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35062024-12-20T22:18:43.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35072024-12-20T22:18:43.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35082024-12-20T22:18:43.556ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.616814ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35092024-12-20T22:18:43.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35102024-12-20T22:18:43.558ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35112024-12-20T22:18:43.558ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35122024-12-20T22:18:43.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35132024-12-20T22:18:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35142024-12-20T22:18:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
35152024-12-20T22:18:43.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35162024-12-20T22:18:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35172024-12-20T22:18:43.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 122.548513ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35182024-12-20T22:18:43.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35192024-12-20T22:18:43.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35202024-12-20T22:18:43.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35212024-12-20T22:18:43.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35222024-12-20T22:18:43.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 126.22299ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35232024-12-20T22:18:43.570ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35242024-12-20T22:18:43.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35252024-12-20T22:18:43.576ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
35262024-12-20T22:18:43.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.879208ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
35272024-12-20T22:18:43.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35282024-12-20T22:18:43.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35292024-12-20T22:18:43.605ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35302024-12-20T22:18:43.605ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35312024-12-20T22:18:43.605ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 163.983351ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35322024-12-20T22:18:43.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 173.397815ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
35332024-12-20T22:18:43.629ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
35342024-12-20T22:18:43.629ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35352024-12-20T22:18:43.629ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "898f86a6-2eea-413e-a3fb-328e991c4895", "content-length": "26", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
35362024-12-20T22:18:43.629ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35372024-12-20T22:18:43.631ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
35382024-12-20T22:18:43.634ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35392024-12-20T22:18:43.634ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35402024-12-20T22:18:43.634ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f14d6938-8bee-412b-a7f9-2e01b6f0b56e", "content-length": "26", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
35412024-12-20T22:18:43.634ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35422024-12-20T22:18:43.636ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35432024-12-20T22:18:43.642ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 200.990002ms iteration = 13 status = {"physical_disks_added":0}
35442024-12-20T22:18:43.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35452024-12-20T22:18:43.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35462024-12-20T22:18:43.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35472024-12-20T22:18:43.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35482024-12-20T22:18:43.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35492024-12-20T22:18:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
35502024-12-20T22:18:43.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35512024-12-20T22:18:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35522024-12-20T22:18:43.664ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 223.139356ms iteration = 10 status = 0
35532024-12-20T22:18:43.679ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 238.531941ms iteration = 10 status = {}
35542024-12-20T22:18:43.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35552024-12-20T22:18:43.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35562024-12-20T22:18:43.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35572024-12-20T22:18:43.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35582024-12-20T22:18:43.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35592024-12-20T22:18:43.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35602024-12-20T22:18:43.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35612024-12-20T22:18:43.712ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35622024-12-20T22:18:43.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35632024-12-20T22:18:43.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35642024-12-20T22:18:43.729ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35652024-12-20T22:18:43.729ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "178ada9b-b693-47b9-b11f-a160542c997b", "content-length": "1", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
35662024-12-20T22:18:43.730ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35672024-12-20T22:18:43.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35682024-12-20T22:18:43.732ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 291.582125ms iteration = 10 status = null
35692024-12-20T22:18:43.739ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35702024-12-20T22:18:43.739ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35712024-12-20T22:18:43.739ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a348e7c9-add0-4605-b393-a0b252ffe61f", "content-length": "372", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
35722024-12-20T22:18:43.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35732024-12-20T22:18:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35742024-12-20T22:18:43.774ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35752024-12-20T22:18:43.775ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ace37b5c-037c-4e6f-86dd-c24da4d39450", "content-length": "691", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
35762024-12-20T22:18:43.775ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35772024-12-20T22:18:43.775ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35782024-12-20T22:18:43.775ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35792024-12-20T22:18:43.776ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 335.112162ms iteration = 10 status = {}
35802024-12-20T22:18:43.804ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
35812024-12-20T22:18:43.804ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35822024-12-20T22:18:43.805ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c97b61a4-b3f1-4742-b323-b14213e7c9f7", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
35832024-12-20T22:18:43.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35842024-12-20T22:18:43.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35852024-12-20T22:18:43.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35862024-12-20T22:18:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35872024-12-20T22:18:43.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35882024-12-20T22:18:43.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35892024-12-20T22:18:43.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35902024-12-20T22:18:43.818ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35912024-12-20T22:18:43.818ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35922024-12-20T22:18:43.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35932024-12-20T22:18:43.819ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0b93a208-b4d8-4587-8ae7-781cc84b930e", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
35942024-12-20T22:18:43.820ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
35952024-12-20T22:18:43.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35962024-12-20T22:18:43.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35972024-12-20T22:18:43.821ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 379.854173ms iteration = 11 status = {}
35982024-12-20T22:18:43.836ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35992024-12-20T22:18:43.836ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "64099802-882b-4bc2-b748-0d5185fb71e2", "content-length": "134", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
36002024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36012024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
36022024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36032024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36042024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36052024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36062024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36072024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36082024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36092024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36102024-12-20T22:18:43.837ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
36112024-12-20T22:18:43.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36122024-12-20T22:18:43.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36132024-12-20T22:18:43.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36142024-12-20T22:18:43.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e4dceb7-16d3-44cb-a163-e6c5e4121b1f", "content-length": "2", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
36152024-12-20T22:18:43.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36162024-12-20T22:18:43.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d3dbee0-9bb3-4765-b4bd-765ee61d4c23", "content-length": "52", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
36172024-12-20T22:18:43.840ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
36182024-12-20T22:18:43.840ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36192024-12-20T22:18:43.950ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2aa9b055-0002-4775-bce7-a0501df0f13a", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
36202024-12-20T22:18:43.950ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
36212024-12-20T22:18:43.950ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36222024-12-20T22:18:44.052ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c34c3e5d-f95f-4720-8e37-d9b9a9f8ab42", "content-length": "682", "date": "Fri, 20 Dec 2024 22:18:43 GMT"} })
36232024-12-20T22:18:44.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36242024-12-20T22:18:44.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36252024-12-20T22:18:44.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36262024-12-20T22:18:44.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36272024-12-20T22:18:44.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36282024-12-20T22:18:44.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36292024-12-20T22:18:44.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36302024-12-20T22:18:44.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36312024-12-20T22:18:44.067ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.595636ms iteration = 10 status = {}
36322024-12-20T22:18:44.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a3f8fdbd-e5a5-430f-9c22-95551cd32f8c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36332024-12-20T22:18:44.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a3f8fdbd-e5a5-430f-9c22-95551cd32f8c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36342024-12-20T22:18:44.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a3f8fdbd-e5a5-430f-9c22-95551cd32f8c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36352024-12-20T22:18:44.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ae20e0f0-9fc4-4b1a-a5f3-0d4b85289602 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36362024-12-20T22:18:44.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ae20e0f0-9fc4-4b1a-a5f3-0d4b85289602 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36372024-12-20T22:18:44.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ae20e0f0-9fc4-4b1a-a5f3-0d4b85289602 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36382024-12-20T22:18:45.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9afd72f0-a07e-44c4-ac54-953f726f0246 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36392024-12-20T22:18:45.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9afd72f0-a07e-44c4-ac54-953f726f0246 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36402024-12-20T22:18:45.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9afd72f0-a07e-44c4-ac54-953f726f0246 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36412024-12-20T22:18:45.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1692 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 5d211830-099e-42e1-bbb2-5cb12ba74296 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
36422024-12-20T22:18:46.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fce355a1-824b-4dd8-b33e-374dc7cd8b45 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36432024-12-20T22:18:46.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fce355a1-824b-4dd8-b33e-374dc7cd8b45 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36442024-12-20T22:18:46.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fce355a1-824b-4dd8-b33e-374dc7cd8b45 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36452024-12-20T22:18:47.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1480246f-4fd6-481a-b38a-8305dd4ac89c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36462024-12-20T22:18:47.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1480246f-4fd6-481a-b38a-8305dd4ac89c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36472024-12-20T22:18:47.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1480246f-4fd6-481a-b38a-8305dd4ac89c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36482024-12-20T22:18:48.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aced3f6d-4eb9-4aad-b9cf-1bb54fc36fdc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36492024-12-20T22:18:48.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aced3f6d-4eb9-4aad-b9cf-1bb54fc36fdc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36502024-12-20T22:18:48.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aced3f6d-4eb9-4aad-b9cf-1bb54fc36fdc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36512024-12-20T22:18:49.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = da856d6c-20ac-4f05-9c54-ac9e15b07b6b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36522024-12-20T22:18:49.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = da856d6c-20ac-4f05-9c54-ac9e15b07b6b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36532024-12-20T22:18:49.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = da856d6c-20ac-4f05-9c54-ac9e15b07b6b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36542024-12-20T22:18:50.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf6663a3-aafc-437d-a990-3ec7d1d039d1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36552024-12-20T22:18:50.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf6663a3-aafc-437d-a990-3ec7d1d039d1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36562024-12-20T22:18:50.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf6663a3-aafc-437d-a990-3ec7d1d039d1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36572024-12-20T22:18:51.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff121784-5643-4c98-ad39-77063b5e38e2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36582024-12-20T22:18:51.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff121784-5643-4c98-ad39-77063b5e38e2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36592024-12-20T22:18:51.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff121784-5643-4c98-ad39-77063b5e38e2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36602024-12-20T22:18:52.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8f7e6413-5eff-480c-92dd-418b9289b1c7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36612024-12-20T22:18:52.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8f7e6413-5eff-480c-92dd-418b9289b1c7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36622024-12-20T22:18:52.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8f7e6413-5eff-480c-92dd-418b9289b1c7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36632024-12-20T22:18:53.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6f53cb58-9c6c-4546-8f37-5680ba5ba12b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36642024-12-20T22:18:53.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6f53cb58-9c6c-4546-8f37-5680ba5ba12b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36652024-12-20T22:18:53.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6f53cb58-9c6c-4546-8f37-5680ba5ba12b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36662024-12-20T22:18:53.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
36672024-12-20T22:18:53.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
36682024-12-20T22:18:53.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36692024-12-20T22:18:53.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36702024-12-20T22:18:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36712024-12-20T22:18:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36722024-12-20T22:18:53.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36732024-12-20T22:18:53.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36742024-12-20T22:18:53.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36752024-12-20T22:18:53.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.418635ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36762024-12-20T22:18:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36772024-12-20T22:18:53.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36782024-12-20T22:18:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36792024-12-20T22:18:53.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36802024-12-20T22:18:53.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36812024-12-20T22:18:53.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36822024-12-20T22:18:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
36832024-12-20T22:18:53.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36842024-12-20T22:18:53.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36852024-12-20T22:18:53.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
36862024-12-20T22:18:53.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.85486ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
36872024-12-20T22:18:54.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b439c839-5e25-4720-abe7-15a3d1e2ffe0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36882024-12-20T22:18:54.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b439c839-5e25-4720-abe7-15a3d1e2ffe0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36892024-12-20T22:18:54.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b439c839-5e25-4720-abe7-15a3d1e2ffe0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36902024-12-20T22:18:55.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 534fb0c6-77ee-4df0-8fe6-4e4a9b21c595 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36912024-12-20T22:18:55.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 534fb0c6-77ee-4df0-8fe6-4e4a9b21c595 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36922024-12-20T22:18:55.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 534fb0c6-77ee-4df0-8fe6-4e4a9b21c595 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36932024-12-20T22:18:55.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1752 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 6ee5eded-62b1-47f9-a77f-6b7f05267aeb response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
36942024-12-20T22:18:56.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 47685c4c-e167-4991-b548-2515cf615a78 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36952024-12-20T22:18:56.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 47685c4c-e167-4991-b548-2515cf615a78 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36962024-12-20T22:18:56.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 47685c4c-e167-4991-b548-2515cf615a78 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36972024-12-20T22:18:57.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 64c46c1a-745b-44a3-9f95-4557d098c106 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36982024-12-20T22:18:57.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 64c46c1a-745b-44a3-9f95-4557d098c106 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
36992024-12-20T22:18:57.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 64c46c1a-745b-44a3-9f95-4557d098c106 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37002024-12-20T22:18:58.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e66a6b84-4d13-4270-95dc-dae564896283 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37012024-12-20T22:18:58.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e66a6b84-4d13-4270-95dc-dae564896283 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37022024-12-20T22:18:58.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e66a6b84-4d13-4270-95dc-dae564896283 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37032024-12-20T22:18:59.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a7c2c4c3-e934-495e-8748-23189829eee3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37042024-12-20T22:18:59.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a7c2c4c3-e934-495e-8748-23189829eee3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37052024-12-20T22:18:59.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a7c2c4c3-e934-495e-8748-23189829eee3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37062024-12-20T22:19:00.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 24b5dd75-d0ab-46bc-b6ed-187a80d78543 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37072024-12-20T22:19:00.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 24b5dd75-d0ab-46bc-b6ed-187a80d78543 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37082024-12-20T22:19:00.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 24b5dd75-d0ab-46bc-b6ed-187a80d78543 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37092024-12-20T22:19:01.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5be142f6-f2df-4879-9c5a-3b3602dcadd2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37102024-12-20T22:19:01.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5be142f6-f2df-4879-9c5a-3b3602dcadd2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37112024-12-20T22:19:01.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5be142f6-f2df-4879-9c5a-3b3602dcadd2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37122024-12-20T22:19:02.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 052358df-31f3-4573-8b51-78660a742e99 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37132024-12-20T22:19:02.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 052358df-31f3-4573-8b51-78660a742e99 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37142024-12-20T22:19:02.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 052358df-31f3-4573-8b51-78660a742e99 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37152024-12-20T22:19:03.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
37162024-12-20T22:19:03.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
37172024-12-20T22:19:03.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37182024-12-20T22:19:03.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37192024-12-20T22:19:03.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37202024-12-20T22:19:03.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37212024-12-20T22:19:03.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37222024-12-20T22:19:03.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37232024-12-20T22:19:03.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242024-12-20T22:19:03.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.94187ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37252024-12-20T22:19:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37262024-12-20T22:19:03.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37272024-12-20T22:19:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37282024-12-20T22:19:03.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37292024-12-20T22:19:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37302024-12-20T22:19:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312024-12-20T22:19:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
37322024-12-20T22:19:03.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37332024-12-20T22:19:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37342024-12-20T22:19:03.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
37352024-12-20T22:19:03.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.459136ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
37362024-12-20T22:19:03.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b5a44560-31af-44d5-90e1-31ce36242f62 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37372024-12-20T22:19:03.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b5a44560-31af-44d5-90e1-31ce36242f62 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37382024-12-20T22:19:03.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b5a44560-31af-44d5-90e1-31ce36242f62 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37392024-12-20T22:19:04.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 064abf47-5431-4a18-8c75-4ab6fa002728 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37402024-12-20T22:19:04.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 064abf47-5431-4a18-8c75-4ab6fa002728 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37412024-12-20T22:19:04.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 064abf47-5431-4a18-8c75-4ab6fa002728 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37422024-12-20T22:19:05.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93c709d4-1c34-4407-bca8-57413676f159 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37432024-12-20T22:19:05.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93c709d4-1c34-4407-bca8-57413676f159 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37442024-12-20T22:19:05.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93c709d4-1c34-4407-bca8-57413676f159 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37452024-12-20T22:19:05.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1674 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 76c56994-cdd7-48db-b3f1-9ed04666e210 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
37462024-12-20T22:19:06.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 16e582f9-295d-41bd-8e5c-c1e0ecb90c3d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37472024-12-20T22:19:06.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 16e582f9-295d-41bd-8e5c-c1e0ecb90c3d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37482024-12-20T22:19:06.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 16e582f9-295d-41bd-8e5c-c1e0ecb90c3d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37492024-12-20T22:19:07.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 62c6975d-b985-4109-8f91-1465c2fd4197 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37502024-12-20T22:19:07.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 62c6975d-b985-4109-8f91-1465c2fd4197 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37512024-12-20T22:19:07.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 62c6975d-b985-4109-8f91-1465c2fd4197 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37522024-12-20T22:19:08.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 086cbe59-0b94-4131-8f88-3c8f90756325 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37532024-12-20T22:19:08.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 086cbe59-0b94-4131-8f88-3c8f90756325 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37542024-12-20T22:19:08.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 086cbe59-0b94-4131-8f88-3c8f90756325 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37552024-12-20T22:19:09.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dc9dbfae-6080-4510-a65b-ac1ff249f0d2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37562024-12-20T22:19:09.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dc9dbfae-6080-4510-a65b-ac1ff249f0d2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37572024-12-20T22:19:09.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dc9dbfae-6080-4510-a65b-ac1ff249f0d2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37582024-12-20T22:19:10.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f0544a74-8632-4ec2-9b12-a52de9ab362a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37592024-12-20T22:19:10.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f0544a74-8632-4ec2-9b12-a52de9ab362a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37602024-12-20T22:19:10.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f0544a74-8632-4ec2-9b12-a52de9ab362a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37612024-12-20T22:19:11.246ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61061
37622024-12-20T22:19:11.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61061 req_id = 3ae3b109-77d5-4f24-a24f-9491718c298a roles = RoleSet { roles: {} } uri = /metrics/producers
37632024-12-20T22:19:11.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61061 req_id = 3ae3b109-77d5-4f24-a24f-9491718c298a resource = Database result = Ok(()) uri = /metrics/producers
37642024-12-20T22:19:11.285ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 409c06a2-2340-44a9-a04f-6817610bd642
37652024-12-20T22:19:11.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39250 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61061 req_id = 3ae3b109-77d5-4f24-a24f-9491718c298a response_code = 201 uri = /metrics/producers
37662024-12-20T22:19:11.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 586a5261-4b0d-495b-8907-e2a286407fc1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37672024-12-20T22:19:11.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 586a5261-4b0d-495b-8907-e2a286407fc1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37682024-12-20T22:19:11.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 586a5261-4b0d-495b-8907-e2a286407fc1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37692024-12-20T22:19:12.231ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35464
37702024-12-20T22:19:12.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35464 req_id = 0491bdb3-9ee9-46b0-961b-a1669edc1575 roles = RoleSet { roles: {} } uri = /metrics/producers
37712024-12-20T22:19:12.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35464 req_id = 0491bdb3-9ee9-46b0-961b-a1669edc1575 resource = Database result = Ok(()) uri = /metrics/producers
37722024-12-20T22:19:12.276ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 1cf20796-1e8a-4632-b82f-1c78cae2c84a
37732024-12-20T22:19:12.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44843 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35464 req_id = 0491bdb3-9ee9-46b0-961b-a1669edc1575 response_code = 201 uri = /metrics/producers
37742024-12-20T22:19:12.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b377550c-c19f-4b09-8467-5177558830dd roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37752024-12-20T22:19:12.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b377550c-c19f-4b09-8467-5177558830dd resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37762024-12-20T22:19:12.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b377550c-c19f-4b09-8467-5177558830dd response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
37772024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
37782024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
37792024-12-20T22:19:13.441ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
37802024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37812024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
37822024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
37832024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37842024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37852024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
37862024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
37872024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37882024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37892024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
37902024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
37912024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37922024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37932024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37942024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
37952024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
37962024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37972024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
37982024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37992024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
38002024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
38012024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
38022024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
38032024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38042024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38052024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
38062024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38072024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
38082024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38092024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
38102024-12-20T22:19:13.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38112024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
38122024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
38132024-12-20T22:19:13.442ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
38142024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.32\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
38152024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
38162024-12-20T22:19:13.442ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
38172024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
38182024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38192024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
38202024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38212024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38222024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
38232024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38242024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
38252024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
38262024-12-20T22:19:13.442ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:09:13.441877623 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38272024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38282024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
38292024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38302024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
38312024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
38322024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38332024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38342024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
38352024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
38362024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
38372024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
38382024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38392024-12-20T22:19:13.442ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38402024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38412024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
38422024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38432024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38442024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38452024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38462024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38472024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38482024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
38492024-12-20T22:19:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38502024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38512024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38522024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38532024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38542024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38552024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38562024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38572024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38582024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38592024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38602024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38612024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38622024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38632024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38642024-12-20T22:19:13.443ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1180, tv_nsec: 371800211 } })
38652024-12-20T22:19:13.443ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1180, tv_nsec: 371824772 } })
38662024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38672024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38682024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38692024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
38702024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.595177ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
38712024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
38722024-12-20T22:19:13.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.594956ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
38732024-12-20T22:19:13.445ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38742024-12-20T22:19:13.445ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1180, tv_nsec: 374897183 } })
38752024-12-20T22:19:13.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38762024-12-20T22:19:13.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
38772024-12-20T22:19:13.446ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.902389ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38782024-12-20T22:19:13.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38792024-12-20T22:19:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
38802024-12-20T22:19:13.447ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38812024-12-20T22:19:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38822024-12-20T22:19:13.448ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38832024-12-20T22:19:13.448ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
38842024-12-20T22:19:13.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38852024-12-20T22:19:13.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38862024-12-20T22:19:13.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38872024-12-20T22:19:13.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38882024-12-20T22:19:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38892024-12-20T22:19:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38902024-12-20T22:19:13.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38912024-12-20T22:19:13.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38922024-12-20T22:19:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38932024-12-20T22:19:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38942024-12-20T22:19:13.450ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.618177ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
38952024-12-20T22:19:13.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.368264ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
38962024-12-20T22:19:13.451ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38972024-12-20T22:19:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38982024-12-20T22:19:13.452ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38992024-12-20T22:19:13.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39002024-12-20T22:19:13.453ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:09:13.441877623 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39012024-12-20T22:19:13.453ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.761218ms iteration = 6 status = {"expiration":"2024-12-20T22:09:13.441877623Z","pruned":[]}
39022024-12-20T22:19:13.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1180, tv_nsec: 384106735 } })
39032024-12-20T22:19:13.455ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39042024-12-20T22:19:13.456ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
39052024-12-20T22:19:13.456ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
39062024-12-20T22:19:13.456ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.361395ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
39072024-12-20T22:19:13.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39082024-12-20T22:19:13.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39092024-12-20T22:19:13.456ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39102024-12-20T22:19:13.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39112024-12-20T22:19:13.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39122024-12-20T22:19:13.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.8306ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
39132024-12-20T22:19:13.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39142024-12-20T22:19:13.460ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39152024-12-20T22:19:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39162024-12-20T22:19:13.460ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39172024-12-20T22:19:13.460ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39182024-12-20T22:19:13.460ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39192024-12-20T22:19:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39202024-12-20T22:19:13.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39212024-12-20T22:19:13.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39222024-12-20T22:19:13.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39232024-12-20T22:19:13.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39242024-12-20T22:19:13.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39252024-12-20T22:19:13.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39262024-12-20T22:19:13.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39272024-12-20T22:19:13.461ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1180, tv_nsec: 390709762 } })
39282024-12-20T22:19:13.461ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39292024-12-20T22:19:13.462ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
39302024-12-20T22:19:13.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39312024-12-20T22:19:13.462ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39322024-12-20T22:19:13.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39332024-12-20T22:19:13.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39342024-12-20T22:19:13.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39352024-12-20T22:19:13.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39362024-12-20T22:19:13.472ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39372024-12-20T22:19:13.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39382024-12-20T22:19:13.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39392024-12-20T22:19:13.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39402024-12-20T22:19:13.481ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39412024-12-20T22:19:13.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39422024-12-20T22:19:13.484ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39432024-12-20T22:19:13.484ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 42.968522ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39442024-12-20T22:19:13.490ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39452024-12-20T22:19:13.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39462024-12-20T22:19:13.516ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39472024-12-20T22:19:13.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39482024-12-20T22:19:13.524ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
39492024-12-20T22:19:13.524ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
39502024-12-20T22:19:13.524ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.025496ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
39512024-12-20T22:19:13.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39522024-12-20T22:19:13.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39532024-12-20T22:19:13.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39542024-12-20T22:19:13.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39552024-12-20T22:19:13.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39562024-12-20T22:19:13.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39572024-12-20T22:19:13.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39582024-12-20T22:19:13.536ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39592024-12-20T22:19:13.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39602024-12-20T22:19:13.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39612024-12-20T22:19:13.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39622024-12-20T22:19:13.539ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39632024-12-20T22:19:13.539ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39642024-12-20T22:19:13.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39652024-12-20T22:19:13.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39662024-12-20T22:19:13.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39672024-12-20T22:19:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39682024-12-20T22:19:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39692024-12-20T22:19:13.540ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39702024-12-20T22:19:13.540ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39712024-12-20T22:19:13.540ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39722024-12-20T22:19:13.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39732024-12-20T22:19:13.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39742024-12-20T22:19:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39752024-12-20T22:19:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39762024-12-20T22:19:13.542ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
39772024-12-20T22:19:13.542ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
39782024-12-20T22:19:13.542ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
39792024-12-20T22:19:13.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39802024-12-20T22:19:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39812024-12-20T22:19:13.543ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39822024-12-20T22:19:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39832024-12-20T22:19:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.895966ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
39842024-12-20T22:19:13.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39852024-12-20T22:19:13.547ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39862024-12-20T22:19:13.547ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39872024-12-20T22:19:13.547ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.164499ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39882024-12-20T22:19:13.548ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39892024-12-20T22:19:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39902024-12-20T22:19:13.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39912024-12-20T22:19:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39922024-12-20T22:19:13.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39932024-12-20T22:19:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39942024-12-20T22:19:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
39952024-12-20T22:19:13.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39962024-12-20T22:19:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39972024-12-20T22:19:13.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.521573ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39982024-12-20T22:19:13.557ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39992024-12-20T22:19:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40002024-12-20T22:19:13.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40012024-12-20T22:19:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40022024-12-20T22:19:13.560ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40032024-12-20T22:19:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40042024-12-20T22:19:13.562ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40052024-12-20T22:19:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
40062024-12-20T22:19:13.566ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40072024-12-20T22:19:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40082024-12-20T22:19:13.573ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52687
40092024-12-20T22:19:13.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52687 req_id = 62dbb3c5-8695-415b-8a0d-3c131cd7dc2f roles = RoleSet { roles: {} } uri = /metrics/producers
40102024-12-20T22:19:13.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52687 req_id = 62dbb3c5-8695-415b-8a0d-3c131cd7dc2f resource = Database result = Ok(()) uri = /metrics/producers
40112024-12-20T22:19:13.574ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
40122024-12-20T22:19:13.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 132.521193ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
40132024-12-20T22:19:13.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40142024-12-20T22:19:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40152024-12-20T22:19:13.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 149.161201ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40162024-12-20T22:19:13.594ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 99b0250f-bcf3-46ae-aea9-2bb2360d90eb
40172024-12-20T22:19:13.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20715 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52687 req_id = 62dbb3c5-8695-415b-8a0d-3c131cd7dc2f response_code = 201 uri = /metrics/producers
40182024-12-20T22:19:13.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40192024-12-20T22:19:13.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40202024-12-20T22:19:13.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40212024-12-20T22:19:13.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 156.477245ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40222024-12-20T22:19:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
40232024-12-20T22:19:13.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40242024-12-20T22:19:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40252024-12-20T22:19:13.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40262024-12-20T22:19:13.603ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 161.826219ms iteration = 11 status = 0
40272024-12-20T22:19:13.604ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40282024-12-20T22:19:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40292024-12-20T22:19:13.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40302024-12-20T22:19:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40312024-12-20T22:19:13.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40322024-12-20T22:19:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40332024-12-20T22:19:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40342024-12-20T22:19:13.613ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40352024-12-20T22:19:13.613ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40362024-12-20T22:19:13.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40372024-12-20T22:19:13.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40382024-12-20T22:19:13.616ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
40392024-12-20T22:19:13.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
40402024-12-20T22:19:13.619ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40412024-12-20T22:19:13.619ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb4b27f1-3014-4923-8227-8730ce3d9b1e", "content-length": "26", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
40422024-12-20T22:19:13.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40432024-12-20T22:19:13.620ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40442024-12-20T22:19:13.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40452024-12-20T22:19:13.621ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
40462024-12-20T22:19:13.649ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40472024-12-20T22:19:13.649ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
40482024-12-20T22:19:13.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40492024-12-20T22:19:13.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40502024-12-20T22:19:13.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40512024-12-20T22:19:13.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40522024-12-20T22:19:13.678ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
40532024-12-20T22:19:13.678ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 237.222917ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
40542024-12-20T22:19:13.679ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40552024-12-20T22:19:13.679ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40562024-12-20T22:19:13.680ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "823a7b54-79cc-459f-a9d4-67f7b76b3741", "content-length": "26", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
40572024-12-20T22:19:13.680ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40582024-12-20T22:19:13.682ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40592024-12-20T22:19:13.683ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 242.120377ms iteration = 14 status = {"physical_disks_added":0}
40602024-12-20T22:19:13.758ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40612024-12-20T22:19:13.759ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40622024-12-20T22:19:13.759ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40632024-12-20T22:19:13.760ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4782332d-0756-420d-bf3f-2dc2b7faadd8", "content-length": "26", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
40642024-12-20T22:19:13.760ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40652024-12-20T22:19:13.762ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40662024-12-20T22:19:13.797ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
40672024-12-20T22:19:13.805ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40682024-12-20T22:19:13.805ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40692024-12-20T22:19:13.806ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6f32051-c07b-4440-a8a7-8ab3e7d66f3c", "content-length": "372", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
40702024-12-20T22:19:13.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40712024-12-20T22:19:13.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40722024-12-20T22:19:13.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40732024-12-20T22:19:13.810ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40742024-12-20T22:19:13.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40752024-12-20T22:19:13.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40762024-12-20T22:19:13.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40772024-12-20T22:19:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40782024-12-20T22:19:13.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40792024-12-20T22:19:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40802024-12-20T22:19:13.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40812024-12-20T22:19:13.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40822024-12-20T22:19:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40832024-12-20T22:19:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40842024-12-20T22:19:13.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40852024-12-20T22:19:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40862024-12-20T22:19:13.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40872024-12-20T22:19:13.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40882024-12-20T22:19:13.819ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
40892024-12-20T22:19:13.819ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
40902024-12-20T22:19:13.819ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
40912024-12-20T22:19:13.819ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 377.956855ms iteration = 7 status = {"generation":1}
40922024-12-20T22:19:13.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40932024-12-20T22:19:13.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40942024-12-20T22:19:13.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40952024-12-20T22:19:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
40962024-12-20T22:19:13.823ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40972024-12-20T22:19:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40982024-12-20T22:19:13.834ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40992024-12-20T22:19:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41002024-12-20T22:19:13.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41012024-12-20T22:19:13.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41022024-12-20T22:19:13.839ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41032024-12-20T22:19:13.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41042024-12-20T22:19:13.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41052024-12-20T22:19:13.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41062024-12-20T22:19:13.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = addd5f36-f89d-4acd-8de6-99fa02e15321 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
41072024-12-20T22:19:13.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = addd5f36-f89d-4acd-8de6-99fa02e15321 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
41082024-12-20T22:19:13.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = addd5f36-f89d-4acd-8de6-99fa02e15321 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
41092024-12-20T22:19:13.855ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41102024-12-20T22:19:13.855ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "97618480-cd7f-4ac0-8651-1500f455dd84", "content-length": "1", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
41112024-12-20T22:19:13.857ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41122024-12-20T22:19:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41132024-12-20T22:19:13.863ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 421.432162ms iteration = 11 status = null
41142024-12-20T22:19:13.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41152024-12-20T22:19:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41162024-12-20T22:19:13.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41172024-12-20T22:19:13.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41182024-12-20T22:19:13.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41192024-12-20T22:19:13.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41202024-12-20T22:19:13.882ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
41212024-12-20T22:19:13.882ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41222024-12-20T22:19:13.882ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ffd3005a-2090-45fe-880f-0483328753df", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
41232024-12-20T22:19:13.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41242024-12-20T22:19:13.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41252024-12-20T22:19:13.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41262024-12-20T22:19:13.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41272024-12-20T22:19:13.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41282024-12-20T22:19:13.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41292024-12-20T22:19:13.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41302024-12-20T22:19:13.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41312024-12-20T22:19:13.890ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41322024-12-20T22:19:13.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41332024-12-20T22:19:13.891ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41342024-12-20T22:19:13.892ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41352024-12-20T22:19:13.892ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41362024-12-20T22:19:13.893ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fd5a3616-782c-47e2-ae54-408286d84b70", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
41372024-12-20T22:19:13.894ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 452.891528ms iteration = 12 status = {}
41382024-12-20T22:19:13.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
41392024-12-20T22:19:13.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41402024-12-20T22:19:13.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41412024-12-20T22:19:13.897ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41422024-12-20T22:19:13.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41432024-12-20T22:19:13.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41442024-12-20T22:19:13.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41452024-12-20T22:19:13.900ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41462024-12-20T22:19:13.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41472024-12-20T22:19:13.903ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41482024-12-20T22:19:13.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41492024-12-20T22:19:13.904ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 463.040671ms iteration = 11 status = {}
41502024-12-20T22:19:13.905ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41512024-12-20T22:19:13.905ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f56d1401-a68c-4e77-9d52-c77bbebf8d09", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41522024-12-20T22:19:13.905ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41532024-12-20T22:19:13.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41542024-12-20T22:19:13.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41552024-12-20T22:19:13.909ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
41562024-12-20T22:19:13.909ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 467.97781ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41572024-12-20T22:19:13.910ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5997885e-32cb-48a1-ada3-7120c7b6b6e9", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41582024-12-20T22:19:13.910ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41592024-12-20T22:19:13.912ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41602024-12-20T22:19:13.912ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 471.287763ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41612024-12-20T22:19:13.922ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41622024-12-20T22:19:13.923ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cb8a9116-a2c7-4ca3-862b-44d9bad630ab", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41632024-12-20T22:19:13.923ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41642024-12-20T22:19:13.927ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3af6f779-3e0e-49d1-99cb-98f932300f78", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41652024-12-20T22:19:13.927ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41662024-12-20T22:19:13.932ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "017932e0-e5c5-4b2c-8584-eb3df2873453", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41672024-12-20T22:19:13.932ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41682024-12-20T22:19:13.933ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
41692024-12-20T22:19:13.933ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41702024-12-20T22:19:13.933ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
41712024-12-20T22:19:13.933ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 491.983552ms iteration = 7 status = {"generation":2}
41722024-12-20T22:19:13.935ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41732024-12-20T22:19:13.935ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 493.710379ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41742024-12-20T22:19:13.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41752024-12-20T22:19:13.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41762024-12-20T22:19:13.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41772024-12-20T22:19:13.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
41782024-12-20T22:19:13.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41792024-12-20T22:19:13.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41802024-12-20T22:19:13.950ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41812024-12-20T22:19:13.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41822024-12-20T22:19:13.981ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41832024-12-20T22:19:13.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41842024-12-20T22:19:13.981ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dba4bd5-3d47-4a1b-9779-e14690adb385", "content-length": "691", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
41852024-12-20T22:19:13.981ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41862024-12-20T22:19:13.981ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41872024-12-20T22:19:13.981ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41882024-12-20T22:19:13.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41892024-12-20T22:19:13.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41902024-12-20T22:19:13.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41912024-12-20T22:19:13.982ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 541.222616ms iteration = 11 status = {}
41922024-12-20T22:19:13.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41932024-12-20T22:19:13.984ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
41942024-12-20T22:19:13.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41952024-12-20T22:19:13.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41962024-12-20T22:19:13.988ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
41972024-12-20T22:19:13.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41982024-12-20T22:19:13.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41992024-12-20T22:19:13.993ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42002024-12-20T22:19:13.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42012024-12-20T22:19:13.994ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42022024-12-20T22:19:13.994ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4e55258-d10d-41c2-b69c-7bdda449b5aa", "content-length": "134", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
42032024-12-20T22:19:13.994ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42042024-12-20T22:19:13.994ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
42052024-12-20T22:19:13.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42062024-12-20T22:19:13.995ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42072024-12-20T22:19:13.995ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42082024-12-20T22:19:13.995ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42092024-12-20T22:19:13.995ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42102024-12-20T22:19:13.995ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42112024-12-20T22:19:13.995ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42122024-12-20T22:19:13.995ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42132024-12-20T22:19:13.995ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42142024-12-20T22:19:13.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42152024-12-20T22:19:13.995ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
42162024-12-20T22:19:13.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42172024-12-20T22:19:13.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42182024-12-20T22:19:13.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42192024-12-20T22:19:13.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42202024-12-20T22:19:13.997ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42212024-12-20T22:19:13.997ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b29eca6f-11f8-417b-b0ae-7a1ac092a27d", "content-length": "2", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
42222024-12-20T22:19:13.997ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42232024-12-20T22:19:13.997ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "973bcb51-27a1-4834-a0ae-3eec0fca76b2", "content-length": "52", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
42242024-12-20T22:19:13.997ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
42252024-12-20T22:19:13.997ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42262024-12-20T22:19:13.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42272024-12-20T22:19:13.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42282024-12-20T22:19:14.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42292024-12-20T22:19:14.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42302024-12-20T22:19:14.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42312024-12-20T22:19:14.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42322024-12-20T22:19:14.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42332024-12-20T22:19:14.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42342024-12-20T22:19:14.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42352024-12-20T22:19:14.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
42362024-12-20T22:19:14.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42372024-12-20T22:19:14.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42382024-12-20T22:19:14.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42392024-12-20T22:19:14.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42402024-12-20T22:19:14.012ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42412024-12-20T22:19:14.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42422024-12-20T22:19:14.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42432024-12-20T22:19:14.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
42442024-12-20T22:19:14.017ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42452024-12-20T22:19:14.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42462024-12-20T22:19:14.024ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 6294325a-a534-458e-bb4d-a82bd38fecc7, kind: Service { id: 57b826de-37e7-4730-9cdb-924c3900cca7 }, name: Name("external-dns-57b826de-37e7-4730-9cdb-924c3900cca7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ce073ed-6a64-4650-b03e-71f0f12930d7, kind: Service { id: 238017a4-2d19-43d3-aa35-92a1ed3e9c3a }, name: Name("external-dns-238017a4-2d19-43d3-aa35-92a1ed3e9c3a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 3607a34f-6331-464f-877d-901d32157481, kind: Service { id: 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c }, name: Name("nexus-73e5bc12-d8f1-466a-967d-9d6c8ff45a8c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7a44818-9125-492c-bc37-8f9c5048ca11, kind: Service { id: bb5e4259-2e9e-45b9-9306-cce16be8e04b }, name: Name("nexus-bb5e4259-2e9e-45b9-9306-cce16be8e04b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b13610c9-f459-4f98-bff6-a9dc2fa99a8a, kind: Service { id: b5e0f45a-5c7c-4d02-b3a0-86311690b334 }, name: Name("nexus-b5e0f45a-5c7c-4d02-b3a0-86311690b334"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 70])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
42472024-12-20T22:19:14.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42482024-12-20T22:19:14.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42492024-12-20T22:19:14.026ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42502024-12-20T22:19:14.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
42512024-12-20T22:19:14.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42522024-12-20T22:19:14.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42532024-12-20T22:19:14.029ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
42542024-12-20T22:19:14.029ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6294325a-a534-458e-bb4d-a82bd38fecc7, kind: Service { id: 57b826de-37e7-4730-9cdb-924c3900cca7 }, name: Name("external-dns-57b826de-37e7-4730-9cdb-924c3900cca7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ce073ed-6a64-4650-b03e-71f0f12930d7, kind: Service { id: 238017a4-2d19-43d3-aa35-92a1ed3e9c3a }, name: Name("external-dns-238017a4-2d19-43d3-aa35-92a1ed3e9c3a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3607a34f-6331-464f-877d-901d32157481, kind: Service { id: 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c }, name: Name("nexus-73e5bc12-d8f1-466a-967d-9d6c8ff45a8c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7a44818-9125-492c-bc37-8f9c5048ca11, kind: Service { id: bb5e4259-2e9e-45b9-9306-cce16be8e04b }, name: Name("nexus-bb5e4259-2e9e-45b9-9306-cce16be8e04b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b13610c9-f459-4f98-bff6-a9dc2fa99a8a, kind: Service { id: b5e0f45a-5c7c-4d02-b3a0-86311690b334 }, name: Name("nexus-b5e0f45a-5c7c-4d02-b3a0-86311690b334"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 70])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
42552024-12-20T22:19:14.029ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
42562024-12-20T22:19:14.109ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8b201642-f1b6-4e39-8ef3-d1b85da72a63", "date": "Fri, 20 Dec 2024 22:19:13 GMT"} })
42572024-12-20T22:19:14.109ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
42582024-12-20T22:19:14.109ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42592024-12-20T22:19:14.109ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c0f71c1-f012-40f7-8ae7-904d517f7e59", "content-length": "682", "date": "Fri, 20 Dec 2024 22:19:14 GMT"} })
42602024-12-20T22:19:14.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42612024-12-20T22:19:14.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42622024-12-20T22:19:14.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42632024-12-20T22:19:14.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42642024-12-20T22:19:14.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42652024-12-20T22:19:14.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42662024-12-20T22:19:14.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42672024-12-20T22:19:14.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42682024-12-20T22:19:14.127ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 686.493479ms iteration = 11 status = {}
42692024-12-20T22:19:14.155ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: a0a780c3-0806-4044-8e4b-e91bf0405221, time_created: 2024-12-20T22:14:47.895491Z, time_modified: 2024-12-20T22:14:47.895491Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
42702024-12-20T22:19:14.155ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
42712024-12-20T22:19:14.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42722024-12-20T22:19:14.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42732024-12-20T22:19:14.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42742024-12-20T22:19:14.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42752024-12-20T22:19:14.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42762024-12-20T22:19:14.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
42772024-12-20T22:19:14.198ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
42782024-12-20T22:19:14.204ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "8cdf32cc-4329-47da-8f46-b7d33e1b3ab9", "date": "Fri, 20 Dec 2024 22:19:14 GMT"} })
42792024-12-20T22:19:14.205ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
42802024-12-20T22:19:14.205ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 763.815777ms
42812024-12-20T22:19:14.205ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 763.829227ms iteration = 2 status = {}
42822024-12-20T22:19:14.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f56a9640-fcd7-49a6-b203-93d34c1691e1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
42832024-12-20T22:19:14.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f56a9640-fcd7-49a6-b203-93d34c1691e1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
42842024-12-20T22:19:14.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f56a9640-fcd7-49a6-b203-93d34c1691e1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
42852024-12-20T22:19:14.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8197b758-177d-4372-91ab-88829d9615a5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
42862024-12-20T22:19:14.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8197b758-177d-4372-91ab-88829d9615a5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
42872024-12-20T22:19:14.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8197b758-177d-4372-91ab-88829d9615a5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
42882024-12-20T22:19:15.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1458 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = d88e9525-ed43-4121-b53d-f0c210527d0b response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
42892024-12-20T22:19:15.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c25bc717-c62c-4650-a060-483dc1006f0c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
42902024-12-20T22:19:15.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c25bc717-c62c-4650-a060-483dc1006f0c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
42912024-12-20T22:19:15.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c25bc717-c62c-4650-a060-483dc1006f0c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
42922024-12-20T22:19:16.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6b0c7b24-7fb8-4765-bd99-28e4e949ec6a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
42932024-12-20T22:19:16.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6b0c7b24-7fb8-4765-bd99-28e4e949ec6a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
42942024-12-20T22:19:16.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6b0c7b24-7fb8-4765-bd99-28e4e949ec6a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
42952024-12-20T22:19:17.597ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48891
42962024-12-20T22:19:17.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48891 req_id = 9b1e38e7-169c-4643-a24c-6e345ffedcde roles = RoleSet { roles: {} } uri = /metrics/producers
42972024-12-20T22:19:17.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48891 req_id = 9b1e38e7-169c-4643-a24c-6e345ffedcde resource = Database result = Ok(()) uri = /metrics/producers
42982024-12-20T22:19:17.639ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 03760c77-b0c3-42eb-a705-bfee77be2fbe
42992024-12-20T22:19:17.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41916 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48891 req_id = 9b1e38e7-169c-4643-a24c-6e345ffedcde response_code = 201 uri = /metrics/producers
43002024-12-20T22:19:17.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af637942-8288-4caf-8781-4e55fc5adaab roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43012024-12-20T22:19:17.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af637942-8288-4caf-8781-4e55fc5adaab resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43022024-12-20T22:19:17.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af637942-8288-4caf-8781-4e55fc5adaab response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43032024-12-20T22:19:18.171ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:62414
43042024-12-20T22:19:18.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62414 req_id = 07714636-3a54-4c59-9a5d-a575d795fb72 roles = RoleSet { roles: {} } uri = /metrics/producers
43052024-12-20T22:19:18.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62414 req_id = 07714636-3a54-4c59-9a5d-a575d795fb72 resource = Database result = Ok(()) uri = /metrics/producers
43062024-12-20T22:19:18.208ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = a0a780c3-0806-4044-8e4b-e91bf0405221
43072024-12-20T22:19:18.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37163 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62414 req_id = 07714636-3a54-4c59-9a5d-a575d795fb72 response_code = 201 uri = /metrics/producers
43082024-12-20T22:19:18.811ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:58980
43092024-12-20T22:19:18.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58980 req_id = 933e0f3c-fbf4-4366-adea-af9064541c36 roles = RoleSet { roles: {} } uri = /metrics/producers
43102024-12-20T22:19:18.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58980 req_id = 933e0f3c-fbf4-4366-adea-af9064541c36 resource = Database result = Ok(()) uri = /metrics/producers
43112024-12-20T22:19:18.844ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 7f6e5691-338a-4d1e-8ab4-9564fc795162
43122024-12-20T22:19:18.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33021 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58980 req_id = 933e0f3c-fbf4-4366-adea-af9064541c36 response_code = 201 uri = /metrics/producers
43132024-12-20T22:19:18.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eac15e9a-bc1a-4464-a19a-3a9fe8780465 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43142024-12-20T22:19:18.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eac15e9a-bc1a-4464-a19a-3a9fe8780465 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43152024-12-20T22:19:18.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eac15e9a-bc1a-4464-a19a-3a9fe8780465 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43162024-12-20T22:19:19.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 04282804-f9d5-4307-8c50-5c9361dfbf44 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43172024-12-20T22:19:19.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 04282804-f9d5-4307-8c50-5c9361dfbf44 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43182024-12-20T22:19:19.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 04282804-f9d5-4307-8c50-5c9361dfbf44 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43192024-12-20T22:19:21.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8afd91e-ae05-43e6-acd6-b606c4561892 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43202024-12-20T22:19:21.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8afd91e-ae05-43e6-acd6-b606c4561892 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43212024-12-20T22:19:21.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8afd91e-ae05-43e6-acd6-b606c4561892 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43222024-12-20T22:19:22.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f27437bc-0f8b-434d-ada3-4fdac086c640 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43232024-12-20T22:19:22.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f27437bc-0f8b-434d-ada3-4fdac086c640 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43242024-12-20T22:19:22.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f27437bc-0f8b-434d-ada3-4fdac086c640 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43252024-12-20T22:19:23.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cf5a84f6-f88d-4870-b023-5d01c226020b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43262024-12-20T22:19:23.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cf5a84f6-f88d-4870-b023-5d01c226020b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43272024-12-20T22:19:23.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cf5a84f6-f88d-4870-b023-5d01c226020b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43282024-12-20T22:19:23.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
43292024-12-20T22:19:23.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43302024-12-20T22:19:23.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
43312024-12-20T22:19:23.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43322024-12-20T22:19:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43332024-12-20T22:19:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43342024-12-20T22:19:23.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43352024-12-20T22:19:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43362024-12-20T22:19:23.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43372024-12-20T22:19:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43382024-12-20T22:19:23.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43392024-12-20T22:19:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43402024-12-20T22:19:23.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43412024-12-20T22:19:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
43422024-12-20T22:19:23.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43432024-12-20T22:19:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43442024-12-20T22:19:23.466ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
43452024-12-20T22:19:23.466ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.732929ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
43462024-12-20T22:19:23.472ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43472024-12-20T22:19:23.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43482024-12-20T22:19:23.474ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.422546ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43492024-12-20T22:19:24.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7c5d6ccd-7b96-4d3d-b65f-8d304f7501a8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43502024-12-20T22:19:24.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7c5d6ccd-7b96-4d3d-b65f-8d304f7501a8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43512024-12-20T22:19:24.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7c5d6ccd-7b96-4d3d-b65f-8d304f7501a8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43522024-12-20T22:19:25.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c9a2b4f-199d-42ff-9a73-6e20046911ca roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43532024-12-20T22:19:25.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c9a2b4f-199d-42ff-9a73-6e20046911ca resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43542024-12-20T22:19:25.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c9a2b4f-199d-42ff-9a73-6e20046911ca response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43552024-12-20T22:19:25.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1596 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 3c6a585c-6e0a-43f9-9126-a80b8af74305 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
43562024-12-20T22:19:26.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b33095e8-0e3b-49b7-8563-e2742ebd9acc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43572024-12-20T22:19:26.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b33095e8-0e3b-49b7-8563-e2742ebd9acc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43582024-12-20T22:19:26.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b33095e8-0e3b-49b7-8563-e2742ebd9acc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43592024-12-20T22:19:27.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b65a4778-0ceb-49f0-9e25-7a4882614998 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43602024-12-20T22:19:27.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b65a4778-0ceb-49f0-9e25-7a4882614998 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43612024-12-20T22:19:27.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b65a4778-0ceb-49f0-9e25-7a4882614998 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43622024-12-20T22:19:28.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8fb26ccb-5734-48d9-9f16-fb69ea10b83c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43632024-12-20T22:19:28.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8fb26ccb-5734-48d9-9f16-fb69ea10b83c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43642024-12-20T22:19:28.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8fb26ccb-5734-48d9-9f16-fb69ea10b83c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43652024-12-20T22:19:29.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b0d05654-db98-423d-86a5-3025ccba0898 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43662024-12-20T22:19:29.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b0d05654-db98-423d-86a5-3025ccba0898 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43672024-12-20T22:19:29.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b0d05654-db98-423d-86a5-3025ccba0898 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43682024-12-20T22:19:30.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 247c3e0e-85b4-4888-8448-1b3b5b775c78 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43692024-12-20T22:19:30.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 247c3e0e-85b4-4888-8448-1b3b5b775c78 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43702024-12-20T22:19:30.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 247c3e0e-85b4-4888-8448-1b3b5b775c78 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43712024-12-20T22:19:31.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 85fa63df-b78c-4bb4-acce-aa31f921cb55 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43722024-12-20T22:19:31.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 85fa63df-b78c-4bb4-acce-aa31f921cb55 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43732024-12-20T22:19:31.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 85fa63df-b78c-4bb4-acce-aa31f921cb55 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43742024-12-20T22:19:32.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1cd8e731-69bf-488a-bba2-d717822878be roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43752024-12-20T22:19:32.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1cd8e731-69bf-488a-bba2-d717822878be resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43762024-12-20T22:19:32.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1cd8e731-69bf-488a-bba2-d717822878be response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43772024-12-20T22:19:33.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 28487bbd-2e12-4c2c-a26f-b4dcc8e1fca5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43782024-12-20T22:19:33.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 28487bbd-2e12-4c2c-a26f-b4dcc8e1fca5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43792024-12-20T22:19:33.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 28487bbd-2e12-4c2c-a26f-b4dcc8e1fca5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
43802024-12-20T22:19:33.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
43812024-12-20T22:19:33.440ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
43822024-12-20T22:19:33.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43832024-12-20T22:19:33.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43842024-12-20T22:19:33.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43852024-12-20T22:19:33.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43862024-12-20T22:19:33.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43872024-12-20T22:19:33.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43882024-12-20T22:19:33.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43892024-12-20T22:19:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43902024-12-20T22:19:33.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43912024-12-20T22:19:33.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43922024-12-20T22:19:33.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43932024-12-20T22:19:33.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
43942024-12-20T22:19:33.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43952024-12-20T22:19:33.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43962024-12-20T22:19:33.462ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
43972024-12-20T22:19:33.462ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.91165ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
43982024-12-20T22:19:33.470ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43992024-12-20T22:19:33.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44002024-12-20T22:19:33.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.061523ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44012024-12-20T22:19:34.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8b8fd442-142a-44bc-9bee-5aef9caf6f64 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44022024-12-20T22:19:34.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8b8fd442-142a-44bc-9bee-5aef9caf6f64 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44032024-12-20T22:19:34.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8b8fd442-142a-44bc-9bee-5aef9caf6f64 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44042024-12-20T22:19:35.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e06cd64f-8d2d-45aa-9481-e956e21ae189 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44052024-12-20T22:19:35.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e06cd64f-8d2d-45aa-9481-e956e21ae189 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44062024-12-20T22:19:35.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e06cd64f-8d2d-45aa-9481-e956e21ae189 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44072024-12-20T22:19:35.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 52bcb936-3e00-454d-b542-4ff163b78d63 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
44082024-12-20T22:19:36.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8ae734f1-acff-4aca-8ec5-2ef40f7ac914 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44092024-12-20T22:19:36.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8ae734f1-acff-4aca-8ec5-2ef40f7ac914 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44102024-12-20T22:19:36.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8ae734f1-acff-4aca-8ec5-2ef40f7ac914 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44112024-12-20T22:19:37.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = de0bf66d-fb1b-40ed-8923-503b2e3f7562 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44122024-12-20T22:19:37.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = de0bf66d-fb1b-40ed-8923-503b2e3f7562 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44132024-12-20T22:19:37.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = de0bf66d-fb1b-40ed-8923-503b2e3f7562 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44142024-12-20T22:19:38.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e235d97d-3e86-429a-8fe7-9a1670326aee roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44152024-12-20T22:19:38.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e235d97d-3e86-429a-8fe7-9a1670326aee resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44162024-12-20T22:19:38.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e235d97d-3e86-429a-8fe7-9a1670326aee response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44172024-12-20T22:19:39.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d554b460-8451-4cef-806c-189dfece0fed roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44182024-12-20T22:19:39.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d554b460-8451-4cef-806c-189dfece0fed resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44192024-12-20T22:19:39.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d554b460-8451-4cef-806c-189dfece0fed response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44202024-12-20T22:19:40.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2779b32b-be1a-4fc3-afcf-cdb2acc83988 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44212024-12-20T22:19:40.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2779b32b-be1a-4fc3-afcf-cdb2acc83988 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44222024-12-20T22:19:40.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2779b32b-be1a-4fc3-afcf-cdb2acc83988 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44232024-12-20T22:19:41.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dabc0f92-2477-4584-83ce-3842b752b388 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44242024-12-20T22:19:41.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dabc0f92-2477-4584-83ce-3842b752b388 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44252024-12-20T22:19:41.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dabc0f92-2477-4584-83ce-3842b752b388 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44262024-12-20T22:19:42.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = afb57c76-820d-4c1f-b4b5-0c317b19fc80 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44272024-12-20T22:19:42.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = afb57c76-820d-4c1f-b4b5-0c317b19fc80 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44282024-12-20T22:19:42.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = afb57c76-820d-4c1f-b4b5-0c317b19fc80 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
44292024-12-20T22:19:43.440ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
44302024-12-20T22:19:43.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44312024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
44322024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
44332024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44342024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
44352024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44362024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
44372024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44382024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
44392024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44402024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
44412024-12-20T22:19:43.441ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
44422024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44432024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44442024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
44452024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
44462024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44472024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44482024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
44492024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44502024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
44512024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44522024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
44532024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44542024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
44552024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44562024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
44572024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44582024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
44592024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44602024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
44612024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44622024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
44632024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44642024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44652024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44662024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44672024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44682024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44692024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44702024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44712024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44722024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44732024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44742024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44752024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44762024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44772024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44782024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44792024-12-20T22:19:43.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44802024-12-20T22:19:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44812024-12-20T22:19:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44822024-12-20T22:19:43.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44832024-12-20T22:19:43.445ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1210, tv_nsec: 373816742 } })
44842024-12-20T22:19:43.445ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.424324ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44852024-12-20T22:19:43.445ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
44862024-12-20T22:19:43.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44872024-12-20T22:19:43.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44882024-12-20T22:19:43.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44892024-12-20T22:19:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44902024-12-20T22:19:43.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44912024-12-20T22:19:43.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44922024-12-20T22:19:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44932024-12-20T22:19:43.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44942024-12-20T22:19:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44952024-12-20T22:19:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44962024-12-20T22:19:43.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44972024-12-20T22:19:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44982024-12-20T22:19:43.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1210, tv_nsec: 380646100 } })
44992024-12-20T22:19:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45002024-12-20T22:19:43.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45012024-12-20T22:19:43.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45022024-12-20T22:19:43.452ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
45032024-12-20T22:19:43.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.806619ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45042024-12-20T22:19:43.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45052024-12-20T22:19:43.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45062024-12-20T22:19:43.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45072024-12-20T22:19:43.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45082024-12-20T22:19:43.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45092024-12-20T22:19:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45102024-12-20T22:19:43.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45112024-12-20T22:19:43.463ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45122024-12-20T22:19:43.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45132024-12-20T22:19:43.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45142024-12-20T22:19:43.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45152024-12-20T22:19:43.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
45162024-12-20T22:19:43.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45172024-12-20T22:19:43.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45182024-12-20T22:19:43.467ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45192024-12-20T22:19:43.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45202024-12-20T22:19:43.487ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
45212024-12-20T22:19:43.487ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.261595ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
45222024-12-20T22:19:43.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 82ef255a-2d62-414f-9b64-40f024c64aee roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
45232024-12-20T22:19:43.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 82ef255a-2d62-414f-9b64-40f024c64aee resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
45242024-12-20T22:19:43.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 82ef255a-2d62-414f-9b64-40f024c64aee response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
45252024-12-20T22:19:43.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45262024-12-20T22:19:43.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45272024-12-20T22:19:43.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.301917ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
45282024-12-20T22:19:43.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.222205ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
45292024-12-20T22:19:43.497ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45302024-12-20T22:19:43.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45312024-12-20T22:19:43.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45322024-12-20T22:19:43.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45332024-12-20T22:19:43.501ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45342024-12-20T22:19:43.501ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45352024-12-20T22:19:43.501ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45362024-12-20T22:19:43.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45372024-12-20T22:19:43.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45382024-12-20T22:19:43.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45392024-12-20T22:19:43.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45402024-12-20T22:19:43.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45412024-12-20T22:19:43.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45422024-12-20T22:19:43.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45432024-12-20T22:19:43.507ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45442024-12-20T22:19:43.507ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45452024-12-20T22:19:43.507ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1aef346b-a0c0-4607-81f6-794edc427fce", "content-length": "26", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
45462024-12-20T22:19:43.508ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45472024-12-20T22:19:43.508ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45482024-12-20T22:19:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45492024-12-20T22:19:43.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45502024-12-20T22:19:43.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
45512024-12-20T22:19:43.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45522024-12-20T22:19:43.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45532024-12-20T22:19:43.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45542024-12-20T22:19:43.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45552024-12-20T22:19:43.509ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45562024-12-20T22:19:43.510ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45572024-12-20T22:19:43.510ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45582024-12-20T22:19:43.510ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc0c2b7c-31dc-415c-8997-ce49ce1c666a", "content-length": "26", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
45592024-12-20T22:19:43.510ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45602024-12-20T22:19:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45612024-12-20T22:19:43.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45622024-12-20T22:19:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45632024-12-20T22:19:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45642024-12-20T22:19:43.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45652024-12-20T22:19:43.511ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.387369ms iteration = 12 status = 0
45662024-12-20T22:19:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45672024-12-20T22:19:43.512ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1210, tv_nsec: 440903877 } })
45682024-12-20T22:19:43.512ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
45692024-12-20T22:19:43.512ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45702024-12-20T22:19:43.523ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45712024-12-20T22:19:43.523ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.551131ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45722024-12-20T22:19:43.530ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.580601ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45732024-12-20T22:19:43.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45742024-12-20T22:19:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45752024-12-20T22:19:43.541ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45762024-12-20T22:19:43.541ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45772024-12-20T22:19:43.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45782024-12-20T22:19:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45792024-12-20T22:19:43.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 101.000397ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45802024-12-20T22:19:43.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 135.050559ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
45812024-12-20T22:19:43.580ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45822024-12-20T22:19:43.580ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45832024-12-20T22:19:43.580ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 139.509994ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45842024-12-20T22:19:43.596ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45852024-12-20T22:19:43.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45862024-12-20T22:19:43.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45872024-12-20T22:19:43.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45882024-12-20T22:19:43.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45892024-12-20T22:19:43.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45902024-12-20T22:19:43.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45912024-12-20T22:19:43.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45922024-12-20T22:19:43.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45932024-12-20T22:19:43.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45942024-12-20T22:19:43.638ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 197.488717ms iteration = 15 status = {"physical_disks_added":0}
45952024-12-20T22:19:43.666ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
45962024-12-20T22:19:43.666ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45972024-12-20T22:19:43.666ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d71c191f-18c5-40ae-9c43-63a15891e65e", "content-length": "26", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
45982024-12-20T22:19:43.666ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45992024-12-20T22:19:43.668ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
46002024-12-20T22:19:43.690ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46012024-12-20T22:19:43.690ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46022024-12-20T22:19:43.691ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "21d769d8-1436-4e2e-bb70-54a7516ae38e", "content-length": "372", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
46032024-12-20T22:19:43.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46042024-12-20T22:19:43.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46052024-12-20T22:19:43.737ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46062024-12-20T22:19:43.737ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46072024-12-20T22:19:43.737ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46082024-12-20T22:19:43.737ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d9cab358-eeb4-4e48-a1d8-32cec0bda30c", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
46092024-12-20T22:19:43.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46102024-12-20T22:19:43.737ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff444bab-cb8b-4fbd-80c0-7a66b8daf4bd", "content-length": "1", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
46112024-12-20T22:19:43.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46122024-12-20T22:19:43.739ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46132024-12-20T22:19:43.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46142024-12-20T22:19:43.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46152024-12-20T22:19:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46162024-12-20T22:19:43.740ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 299.843518ms iteration = 12 status = null
46172024-12-20T22:19:43.741ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 299.975779ms iteration = 12 status = {}
46182024-12-20T22:19:43.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46192024-12-20T22:19:43.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46202024-12-20T22:19:43.751ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46212024-12-20T22:19:43.752ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "224e7ebd-2763-4abc-86c4-d06e0c455df3", "content-length": "691", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
46222024-12-20T22:19:43.752ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46232024-12-20T22:19:43.752ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46242024-12-20T22:19:43.752ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46252024-12-20T22:19:43.753ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 312.258403ms iteration = 12 status = {}
46262024-12-20T22:19:43.761ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46272024-12-20T22:19:43.761ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46282024-12-20T22:19:43.761ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a7ef5176-1a28-4c52-9ab3-2087044261cb", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
46292024-12-20T22:19:43.763ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 322.596997ms iteration = 13 status = {}
46302024-12-20T22:19:43.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46312024-12-20T22:19:43.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46322024-12-20T22:19:43.838ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
46332024-12-20T22:19:43.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46342024-12-20T22:19:43.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46352024-12-20T22:19:43.849ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46362024-12-20T22:19:43.849ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff6e9463-2cc2-4263-8b2f-7e9377167733", "content-length": "134", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
46372024-12-20T22:19:43.849ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46382024-12-20T22:19:43.849ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
46392024-12-20T22:19:43.849ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46402024-12-20T22:19:43.849ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46412024-12-20T22:19:43.849ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46422024-12-20T22:19:43.849ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46432024-12-20T22:19:43.849ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46442024-12-20T22:19:43.849ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46452024-12-20T22:19:43.850ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46462024-12-20T22:19:43.850ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46472024-12-20T22:19:43.850ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
46482024-12-20T22:19:43.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46492024-12-20T22:19:43.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46502024-12-20T22:19:43.852ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46512024-12-20T22:19:43.853ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "21441b4f-ff07-43a9-b064-52b2c7ee6c7d", "content-length": "2", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
46522024-12-20T22:19:43.853ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46532024-12-20T22:19:43.853ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2e8de1f-794b-4378-acd6-cf6684dd7f8d", "content-length": "52", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
46542024-12-20T22:19:43.853ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
46552024-12-20T22:19:43.853ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46562024-12-20T22:19:43.971ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "604701c3-c1aa-465c-817a-320d986f4694", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
46572024-12-20T22:19:43.971ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
46582024-12-20T22:19:43.971ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46592024-12-20T22:19:43.971ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f448bf4c-85de-436c-b3f6-aa1ad7c6443f", "content-length": "682", "date": "Fri, 20 Dec 2024 22:19:43 GMT"} })
46602024-12-20T22:19:43.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46612024-12-20T22:19:43.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46622024-12-20T22:19:43.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46632024-12-20T22:19:43.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46642024-12-20T22:19:43.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46652024-12-20T22:19:43.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46662024-12-20T22:19:43.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46672024-12-20T22:19:43.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46682024-12-20T22:19:43.989ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 547.913603ms iteration = 12 status = {}
46692024-12-20T22:19:44.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 79f299db-0318-4ba9-9283-07e3442cf11e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46702024-12-20T22:19:44.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 79f299db-0318-4ba9-9283-07e3442cf11e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46712024-12-20T22:19:44.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 79f299db-0318-4ba9-9283-07e3442cf11e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46722024-12-20T22:19:44.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 15fce885-9b5f-413e-bbdb-cb174c5f1b1f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46732024-12-20T22:19:44.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 15fce885-9b5f-413e-bbdb-cb174c5f1b1f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46742024-12-20T22:19:44.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 15fce885-9b5f-413e-bbdb-cb174c5f1b1f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46752024-12-20T22:19:45.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a8c3febd-fd0e-4bbb-88a6-d583da0b2a9d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46762024-12-20T22:19:45.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a8c3febd-fd0e-4bbb-88a6-d583da0b2a9d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46772024-12-20T22:19:45.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a8c3febd-fd0e-4bbb-88a6-d583da0b2a9d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46782024-12-20T22:19:45.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1453 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = b63fc0c6-d0a9-46b4-8acc-46c474154f02 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
46792024-12-20T22:19:46.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a0755309-f869-4c2c-a2a8-b12eacc9a71e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46802024-12-20T22:19:46.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a0755309-f869-4c2c-a2a8-b12eacc9a71e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46812024-12-20T22:19:46.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a0755309-f869-4c2c-a2a8-b12eacc9a71e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46822024-12-20T22:19:47.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 665d4b8e-58ab-4d6f-89ad-d14ff144fbe4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46832024-12-20T22:19:47.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 665d4b8e-58ab-4d6f-89ad-d14ff144fbe4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46842024-12-20T22:19:47.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 665d4b8e-58ab-4d6f-89ad-d14ff144fbe4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46852024-12-20T22:19:48.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a98f7b7f-7e8d-4c45-bf74-70dbbbeda81f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46862024-12-20T22:19:48.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a98f7b7f-7e8d-4c45-bf74-70dbbbeda81f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46872024-12-20T22:19:48.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a98f7b7f-7e8d-4c45-bf74-70dbbbeda81f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
46882024-12-20T22:19:49.324ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
46892024-12-20T22:19:49.324ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
46902024-12-20T22:19:49.355ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
46912024-12-20T22:19:49.355ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:52731
46922024-12-20T22:19:49.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:52731 req_id = 081ed463-5a8d-4cc9-beac-6dc4327fa601 roles = RoleSet { roles: {} } uri = /metrics/producers
46932024-12-20T22:19:49.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:52731 req_id = 081ed463-5a8d-4cc9-beac-6dc4327fa601 resource = Database result = Ok(()) uri = /metrics/producers
46942024-12-20T22:19:49.365ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
46952024-12-20T22:19:49.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9664 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:52731 req_id = 081ed463-5a8d-4cc9-beac-6dc4327fa601 response_code = 201 uri = /metrics/producers
46962024-12-20T22:19:49.365ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "081ed463-5a8d-4cc9-beac-6dc4327fa601", "content-length": "41", "date": "Fri, 20 Dec 2024 22:19:49 GMT"} })
46972024-12-20T22:19:49.367ZDEBGnexus (producer-registration-task): registered with nexus successfully
46982024-12-20T22:19:49.367ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
46992024-12-20T22:19:49.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 90fbd1ae-4921-4a67-9a42-b08be185c674 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47002024-12-20T22:19:49.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 90fbd1ae-4921-4a67-9a42-b08be185c674 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47012024-12-20T22:19:49.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 90fbd1ae-4921-4a67-9a42-b08be185c674 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47022024-12-20T22:19:50.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81e16e80-f9d3-4a0f-b96f-7fc56ef553f2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47032024-12-20T22:19:50.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81e16e80-f9d3-4a0f-b96f-7fc56ef553f2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47042024-12-20T22:19:50.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81e16e80-f9d3-4a0f-b96f-7fc56ef553f2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47052024-12-20T22:19:51.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a6b6613e-5b6a-43bb-b600-51e0bc247b8a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47062024-12-20T22:19:51.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a6b6613e-5b6a-43bb-b600-51e0bc247b8a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47072024-12-20T22:19:51.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a6b6613e-5b6a-43bb-b600-51e0bc247b8a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47082024-12-20T22:19:52.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a37f6116-03dd-40d5-ac2d-38c5d02d05c4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47092024-12-20T22:19:52.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a37f6116-03dd-40d5-ac2d-38c5d02d05c4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47102024-12-20T22:19:52.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a37f6116-03dd-40d5-ac2d-38c5d02d05c4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47112024-12-20T22:19:53.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
47122024-12-20T22:19:53.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
47132024-12-20T22:19:53.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47142024-12-20T22:19:53.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47152024-12-20T22:19:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47162024-12-20T22:19:53.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47172024-12-20T22:19:53.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47182024-12-20T22:19:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47192024-12-20T22:19:53.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47202024-12-20T22:19:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47212024-12-20T22:19:53.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47222024-12-20T22:19:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47232024-12-20T22:19:53.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47242024-12-20T22:19:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
47252024-12-20T22:19:53.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47262024-12-20T22:19:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47272024-12-20T22:19:53.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
47282024-12-20T22:19:53.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.158043ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
47292024-12-20T22:19:53.470ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47302024-12-20T22:19:53.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47312024-12-20T22:19:53.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.173136ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47322024-12-20T22:19:53.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 988b71b3-314c-4f4a-bb37-9b3bbfa531c5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47332024-12-20T22:19:53.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 988b71b3-314c-4f4a-bb37-9b3bbfa531c5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47342024-12-20T22:19:53.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 988b71b3-314c-4f4a-bb37-9b3bbfa531c5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47352024-12-20T22:19:54.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7285efd9-98f2-4559-a041-950b50358268 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47362024-12-20T22:19:54.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7285efd9-98f2-4559-a041-950b50358268 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47372024-12-20T22:19:54.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7285efd9-98f2-4559-a041-950b50358268 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47382024-12-20T22:19:55.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1292 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 9e7d797f-db4a-4d44-91cb-61f7c075589c response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
47392024-12-20T22:19:55.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ccec9b71-1472-4dac-b5c3-f51e31fd515e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47402024-12-20T22:19:55.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ccec9b71-1472-4dac-b5c3-f51e31fd515e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47412024-12-20T22:19:55.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ccec9b71-1472-4dac-b5c3-f51e31fd515e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47422024-12-20T22:19:56.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a398fb0d-2069-46fa-9828-9c8ee16b16d3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47432024-12-20T22:19:56.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a398fb0d-2069-46fa-9828-9c8ee16b16d3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47442024-12-20T22:19:56.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a398fb0d-2069-46fa-9828-9c8ee16b16d3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47452024-12-20T22:19:57.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3e24f65c-2be5-421b-b209-0047a0b12ad7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47462024-12-20T22:19:57.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3e24f65c-2be5-421b-b209-0047a0b12ad7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47472024-12-20T22:19:57.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3e24f65c-2be5-421b-b209-0047a0b12ad7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47482024-12-20T22:19:58.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 455af8a0-ccec-4312-95e0-f1bbc2cbd37b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47492024-12-20T22:19:58.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 455af8a0-ccec-4312-95e0-f1bbc2cbd37b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47502024-12-20T22:19:58.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 455af8a0-ccec-4312-95e0-f1bbc2cbd37b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47512024-12-20T22:19:59.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2d751b28-25e2-4351-9227-5a52004ee4a7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47522024-12-20T22:19:59.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2d751b28-25e2-4351-9227-5a52004ee4a7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47532024-12-20T22:19:59.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2d751b28-25e2-4351-9227-5a52004ee4a7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47542024-12-20T22:20:00.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c231584f-8f56-44f5-a93d-271ca4da70f5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47552024-12-20T22:20:00.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c231584f-8f56-44f5-a93d-271ca4da70f5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47562024-12-20T22:20:00.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c231584f-8f56-44f5-a93d-271ca4da70f5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47572024-12-20T22:20:01.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 218d8a15-7ced-44a3-b444-a3809704eb33 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47582024-12-20T22:20:01.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 218d8a15-7ced-44a3-b444-a3809704eb33 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47592024-12-20T22:20:01.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 218d8a15-7ced-44a3-b444-a3809704eb33 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47602024-12-20T22:20:02.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a55e47a2-eec0-46db-8238-628c356acb89 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47612024-12-20T22:20:02.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a55e47a2-eec0-46db-8238-628c356acb89 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47622024-12-20T22:20:02.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a55e47a2-eec0-46db-8238-628c356acb89 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47632024-12-20T22:20:03.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
47642024-12-20T22:20:03.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47652024-12-20T22:20:03.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
47662024-12-20T22:20:03.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47672024-12-20T22:20:03.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47682024-12-20T22:20:03.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47692024-12-20T22:20:03.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47702024-12-20T22:20:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47712024-12-20T22:20:03.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47722024-12-20T22:20:03.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.464195ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47732024-12-20T22:20:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47742024-12-20T22:20:03.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47752024-12-20T22:20:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47762024-12-20T22:20:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47772024-12-20T22:20:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47782024-12-20T22:20:03.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47792024-12-20T22:20:03.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
47802024-12-20T22:20:03.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47812024-12-20T22:20:03.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47822024-12-20T22:20:03.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
47832024-12-20T22:20:03.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.167413ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
47842024-12-20T22:20:03.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1479a25f-9b8a-4011-b51d-8464653e3f4c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47852024-12-20T22:20:03.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1479a25f-9b8a-4011-b51d-8464653e3f4c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47862024-12-20T22:20:03.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1479a25f-9b8a-4011-b51d-8464653e3f4c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47872024-12-20T22:20:04.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c86f777f-990d-489c-9547-20f30a96500e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47882024-12-20T22:20:04.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c86f777f-990d-489c-9547-20f30a96500e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47892024-12-20T22:20:04.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c86f777f-990d-489c-9547-20f30a96500e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47902024-12-20T22:20:05.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 5bf91c8d-bb67-4867-8f92-b8fe20c7f116 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
47912024-12-20T22:20:05.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bb65c90a-b776-49b9-ad38-3c697f1db12a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47922024-12-20T22:20:05.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bb65c90a-b776-49b9-ad38-3c697f1db12a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47932024-12-20T22:20:05.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bb65c90a-b776-49b9-ad38-3c697f1db12a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47942024-12-20T22:20:06.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6384e187-d121-46eb-8010-b2bc0e6c7c2f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47952024-12-20T22:20:06.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6384e187-d121-46eb-8010-b2bc0e6c7c2f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47962024-12-20T22:20:07.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6384e187-d121-46eb-8010-b2bc0e6c7c2f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47972024-12-20T22:20:08.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8727b078-083a-4bf0-b3e8-fd18db1b4caa roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47982024-12-20T22:20:08.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8727b078-083a-4bf0-b3e8-fd18db1b4caa resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
47992024-12-20T22:20:08.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8727b078-083a-4bf0-b3e8-fd18db1b4caa response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48002024-12-20T22:20:09.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d4ffbe71-f4a9-45bd-bc81-c09bd01a1b12 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48012024-12-20T22:20:09.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d4ffbe71-f4a9-45bd-bc81-c09bd01a1b12 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48022024-12-20T22:20:09.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d4ffbe71-f4a9-45bd-bc81-c09bd01a1b12 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48032024-12-20T22:20:10.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7af64979-8fab-4055-85b6-9ec1659fdc05 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48042024-12-20T22:20:10.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7af64979-8fab-4055-85b6-9ec1659fdc05 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48052024-12-20T22:20:10.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7af64979-8fab-4055-85b6-9ec1659fdc05 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48062024-12-20T22:20:10.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = c12093a5-d036-4171-820f-dfbc92843f40 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
48072024-12-20T22:20:10.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = c12093a5-d036-4171-820f-dfbc92843f40 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
48082024-12-20T22:20:10.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = c12093a5-d036-4171-820f-dfbc92843f40 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
48092024-12-20T22:20:10.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 47cc9951-c599-4448-b380-8a637c16acf0 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
48102024-12-20T22:20:10.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 47cc9951-c599-4448-b380-8a637c16acf0 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
48112024-12-20T22:20:10.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 47cc9951-c599-4448-b380-8a637c16acf0 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
48122024-12-20T22:20:11.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 00487d0b-cb85-4790-9142-ed82ac7209ed roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48132024-12-20T22:20:11.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 00487d0b-cb85-4790-9142-ed82ac7209ed resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48142024-12-20T22:20:11.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 00487d0b-cb85-4790-9142-ed82ac7209ed response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48152024-12-20T22:20:12.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8b987765-d978-4cea-bc26-38cb5f590cc8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48162024-12-20T22:20:12.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8b987765-d978-4cea-bc26-38cb5f590cc8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48172024-12-20T22:20:12.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8b987765-d978-4cea-bc26-38cb5f590cc8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48182024-12-20T22:20:13.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 19d91da9-c3c9-470a-9029-92d0bb52d4fe roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48192024-12-20T22:20:13.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 19d91da9-c3c9-470a-9029-92d0bb52d4fe resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48202024-12-20T22:20:13.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 19d91da9-c3c9-470a-9029-92d0bb52d4fe response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
48212024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
48222024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
48232024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
48242024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48252024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48262024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
48272024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
48282024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48292024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48302024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
48312024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
48322024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48332024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
48342024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48352024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
48362024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
48372024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48382024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48392024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
48402024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48412024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
48422024-12-20T22:20:13.441ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:10:13.441463394 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
48432024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
48442024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
48452024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
48462024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48472024-12-20T22:20:13.441ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
48482024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48492024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
48502024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
48512024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48522024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48532024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
48542024-12-20T22:20:13.441ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
48552024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
48562024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.91\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
48572024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
48582024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
48592024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48602024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
48612024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48622024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48632024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
48642024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
48652024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48662024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
48672024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48682024-12-20T22:20:13.441ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
48692024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
48702024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48712024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
48722024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48732024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
48742024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48752024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
48762024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48772024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
48782024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
48792024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
48802024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48812024-12-20T22:20:13.442ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48822024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48832024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
48842024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48852024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48862024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
48872024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48882024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48892024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48902024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48912024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48922024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
48932024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48942024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48952024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48962024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48972024-12-20T22:20:13.442ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1240, tv_nsec: 370975403 } })
48982024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48992024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49002024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49012024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49022024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49032024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49042024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49052024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49062024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49072024-12-20T22:20:13.442ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1240, tv_nsec: 371077974 } })
49082024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49092024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49102024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49112024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49122024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49132024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49142024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49152024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49162024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49172024-12-20T22:20:13.442ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
49182024-12-20T22:20:13.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.319693ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
49192024-12-20T22:20:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49202024-12-20T22:20:13.443ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49212024-12-20T22:20:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49222024-12-20T22:20:13.443ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
49232024-12-20T22:20:13.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.010491ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
49242024-12-20T22:20:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49252024-12-20T22:20:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49262024-12-20T22:20:13.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49272024-12-20T22:20:13.446ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.631767ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49282024-12-20T22:20:13.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49292024-12-20T22:20:13.447ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:10:13.441463394 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49302024-12-20T22:20:13.447ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.643707ms iteration = 7 status = {"expiration":"2024-12-20T22:10:13.441463394Z","pruned":[]}
49312024-12-20T22:20:13.447ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1240, tv_nsec: 376178366 } })
49322024-12-20T22:20:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
49332024-12-20T22:20:13.447ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49342024-12-20T22:20:13.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
49352024-12-20T22:20:13.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49362024-12-20T22:20:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49372024-12-20T22:20:13.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49382024-12-20T22:20:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49392024-12-20T22:20:13.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49402024-12-20T22:20:13.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49412024-12-20T22:20:13.453ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49422024-12-20T22:20:13.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49432024-12-20T22:20:13.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49442024-12-20T22:20:13.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49452024-12-20T22:20:13.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49462024-12-20T22:20:13.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49472024-12-20T22:20:13.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49482024-12-20T22:20:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
49492024-12-20T22:20:13.456ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49502024-12-20T22:20:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49512024-12-20T22:20:13.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49522024-12-20T22:20:13.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49532024-12-20T22:20:13.458ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.717278ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
49542024-12-20T22:20:13.460ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1240, tv_nsec: 388666111 } })
49552024-12-20T22:20:13.460ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
49562024-12-20T22:20:13.460ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49572024-12-20T22:20:13.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49582024-12-20T22:20:13.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49592024-12-20T22:20:13.464ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49602024-12-20T22:20:13.472ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49612024-12-20T22:20:13.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49622024-12-20T22:20:13.480ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49632024-12-20T22:20:13.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49642024-12-20T22:20:13.482ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49652024-12-20T22:20:13.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.056524ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49662024-12-20T22:20:13.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
49672024-12-20T22:20:13.485ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49682024-12-20T22:20:13.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49692024-12-20T22:20:13.485ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49702024-12-20T22:20:13.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
49712024-12-20T22:20:13.488ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49722024-12-20T22:20:13.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49732024-12-20T22:20:13.488ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49742024-12-20T22:20:13.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49752024-12-20T22:20:13.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49762024-12-20T22:20:13.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
49772024-12-20T22:20:13.491ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49782024-12-20T22:20:13.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49792024-12-20T22:20:13.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49802024-12-20T22:20:13.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49812024-12-20T22:20:13.492ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49822024-12-20T22:20:13.492ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.123735ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49832024-12-20T22:20:13.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49842024-12-20T22:20:13.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49852024-12-20T22:20:13.496ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49862024-12-20T22:20:13.497ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49872024-12-20T22:20:13.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49882024-12-20T22:20:13.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49892024-12-20T22:20:13.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49902024-12-20T22:20:13.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49912024-12-20T22:20:13.500ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49922024-12-20T22:20:13.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49932024-12-20T22:20:13.503ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
49942024-12-20T22:20:13.503ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 61.271586ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
49952024-12-20T22:20:13.503ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
49962024-12-20T22:20:13.503ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
49972024-12-20T22:20:13.503ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.58051ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
49982024-12-20T22:20:13.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49992024-12-20T22:20:13.505ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50002024-12-20T22:20:13.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.124466ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50012024-12-20T22:20:13.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.030675ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
50022024-12-20T22:20:13.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
50032024-12-20T22:20:13.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50042024-12-20T22:20:13.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50052024-12-20T22:20:13.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
50062024-12-20T22:20:13.510ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50072024-12-20T22:20:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50082024-12-20T22:20:13.517ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50092024-12-20T22:20:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50102024-12-20T22:20:13.523ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50112024-12-20T22:20:13.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50122024-12-20T22:20:13.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50132024-12-20T22:20:13.525ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50142024-12-20T22:20:13.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50152024-12-20T22:20:13.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50162024-12-20T22:20:13.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50172024-12-20T22:20:13.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
50182024-12-20T22:20:13.529ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
50192024-12-20T22:20:13.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
50202024-12-20T22:20:13.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50212024-12-20T22:20:13.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50222024-12-20T22:20:13.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50232024-12-20T22:20:13.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50242024-12-20T22:20:13.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50252024-12-20T22:20:13.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50262024-12-20T22:20:13.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 96.570663ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
50272024-12-20T22:20:13.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50282024-12-20T22:20:13.539ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50292024-12-20T22:20:13.539ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50302024-12-20T22:20:13.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50312024-12-20T22:20:13.540ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 98.879975ms iteration = 4 status = {"nsuccess":5}
50322024-12-20T22:20:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50332024-12-20T22:20:13.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1240, tv_nsec: 470356693 } })
50342024-12-20T22:20:13.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
50352024-12-20T22:20:13.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50362024-12-20T22:20:13.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50372024-12-20T22:20:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50382024-12-20T22:20:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50392024-12-20T22:20:13.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50402024-12-20T22:20:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50412024-12-20T22:20:13.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50422024-12-20T22:20:13.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50432024-12-20T22:20:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50442024-12-20T22:20:13.546ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
50452024-12-20T22:20:13.546ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.112508ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
50462024-12-20T22:20:13.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50472024-12-20T22:20:13.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50482024-12-20T22:20:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50492024-12-20T22:20:13.551ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50502024-12-20T22:20:13.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50512024-12-20T22:20:13.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50522024-12-20T22:20:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50532024-12-20T22:20:13.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
50542024-12-20T22:20:13.555ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
50552024-12-20T22:20:13.555ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
50562024-12-20T22:20:13.555ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 114.074488ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
50572024-12-20T22:20:13.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50582024-12-20T22:20:13.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50592024-12-20T22:20:13.559ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50602024-12-20T22:20:13.559ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50612024-12-20T22:20:13.559ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50622024-12-20T22:20:13.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50632024-12-20T22:20:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50642024-12-20T22:20:13.563ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50652024-12-20T22:20:13.563ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50662024-12-20T22:20:13.563ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50672024-12-20T22:20:13.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50682024-12-20T22:20:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50692024-12-20T22:20:13.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 127.473243ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50702024-12-20T22:20:13.580ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50712024-12-20T22:20:13.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 139.576795ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
50722024-12-20T22:20:13.582ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50732024-12-20T22:20:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50742024-12-20T22:20:13.590ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50752024-12-20T22:20:13.590ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50762024-12-20T22:20:13.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50772024-12-20T22:20:13.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50782024-12-20T22:20:13.598ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50792024-12-20T22:20:13.598ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50802024-12-20T22:20:13.598ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "925df38c-e3cd-44ee-9c32-1cb450eb4962", "content-length": "26", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
50812024-12-20T22:20:13.598ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50822024-12-20T22:20:13.600ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.152372ms iteration = 16 status = {"physical_disks_added":0}
50832024-12-20T22:20:13.601ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50842024-12-20T22:20:13.603ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50852024-12-20T22:20:13.603ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50862024-12-20T22:20:13.603ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c99c3855-5cdc-462e-b118-19f9b15dfaa9", "content-length": "26", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
50872024-12-20T22:20:13.603ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50882024-12-20T22:20:13.605ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50892024-12-20T22:20:13.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50902024-12-20T22:20:13.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50912024-12-20T22:20:13.632ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50922024-12-20T22:20:13.709ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
50932024-12-20T22:20:13.709ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50942024-12-20T22:20:13.710ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9e9b50b-b4f6-475f-9cad-b93ebbc7dc40", "content-length": "26", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
50952024-12-20T22:20:13.710ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50962024-12-20T22:20:13.712ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
50972024-12-20T22:20:13.732ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50982024-12-20T22:20:13.732ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50992024-12-20T22:20:13.733ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "90913892-45c6-4b12-9818-7fbe1522b2bb", "content-length": "372", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
51002024-12-20T22:20:13.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51012024-12-20T22:20:13.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51022024-12-20T22:20:13.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51032024-12-20T22:20:13.735ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 293.679306ms iteration = 13 status = 0
51042024-12-20T22:20:13.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51052024-12-20T22:20:13.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51062024-12-20T22:20:13.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51072024-12-20T22:20:13.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51082024-12-20T22:20:13.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51092024-12-20T22:20:13.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51102024-12-20T22:20:13.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51112024-12-20T22:20:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51122024-12-20T22:20:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51132024-12-20T22:20:13.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51142024-12-20T22:20:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51152024-12-20T22:20:13.753ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
51162024-12-20T22:20:13.753ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
51172024-12-20T22:20:13.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51182024-12-20T22:20:13.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51192024-12-20T22:20:13.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51202024-12-20T22:20:13.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51212024-12-20T22:20:13.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51222024-12-20T22:20:13.770ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 328.805369ms iteration = 13 status = {}
51232024-12-20T22:20:13.772ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
51242024-12-20T22:20:13.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51252024-12-20T22:20:13.775ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51262024-12-20T22:20:13.775ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "de042093-03f5-475b-b8a1-c0709b5f7fba", "content-length": "1", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
51272024-12-20T22:20:13.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51282024-12-20T22:20:13.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51292024-12-20T22:20:13.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51302024-12-20T22:20:13.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51312024-12-20T22:20:13.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51322024-12-20T22:20:13.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51332024-12-20T22:20:13.781ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
51342024-12-20T22:20:13.781ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51352024-12-20T22:20:13.781ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
51362024-12-20T22:20:13.781ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 339.553928ms iteration = 8 status = {"generation":1}
51372024-12-20T22:20:13.784ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51382024-12-20T22:20:13.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51392024-12-20T22:20:13.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51402024-12-20T22:20:13.787ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 345.959352ms iteration = 13 status = null
51412024-12-20T22:20:13.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51422024-12-20T22:20:13.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51432024-12-20T22:20:13.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51442024-12-20T22:20:13.792ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51452024-12-20T22:20:13.792ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51462024-12-20T22:20:13.792ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 350.644899ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51472024-12-20T22:20:13.793ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51482024-12-20T22:20:13.793ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
51492024-12-20T22:20:13.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51502024-12-20T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51512024-12-20T22:20:13.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51522024-12-20T22:20:13.809ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
51532024-12-20T22:20:13.809ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 367.765021ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51542024-12-20T22:20:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51552024-12-20T22:20:13.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51562024-12-20T22:20:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51572024-12-20T22:20:13.816ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
51582024-12-20T22:20:13.816ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51592024-12-20T22:20:13.816ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
51602024-12-20T22:20:13.816ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 374.263647ms iteration = 8 status = {"generation":2}
51612024-12-20T22:20:13.818ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
51622024-12-20T22:20:13.819ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "384e98bb-0934-435e-bf0c-2f7801d88c4c", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51632024-12-20T22:20:13.819ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51642024-12-20T22:20:13.821ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ef06164d-df8c-4890-8fb6-74bd30dc7f80", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51652024-12-20T22:20:13.821ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51662024-12-20T22:20:13.824ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51672024-12-20T22:20:13.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 382.756503ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
51682024-12-20T22:20:13.841ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51692024-12-20T22:20:13.841ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51702024-12-20T22:20:13.842ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "21f62754-1982-44c6-83a9-b549655926af", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
51712024-12-20T22:20:13.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51722024-12-20T22:20:13.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51732024-12-20T22:20:13.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51742024-12-20T22:20:13.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51752024-12-20T22:20:13.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51762024-12-20T22:20:13.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51772024-12-20T22:20:13.970ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51782024-12-20T22:20:13.970ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "91e04b23-05e3-4873-9b03-e302fa942864", "content-length": "691", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
51792024-12-20T22:20:13.970ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51802024-12-20T22:20:13.970ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51812024-12-20T22:20:13.970ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51822024-12-20T22:20:13.972ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 530.728732ms iteration = 13 status = {}
51832024-12-20T22:20:13.973ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51842024-12-20T22:20:13.973ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51852024-12-20T22:20:13.973ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5141ebca-e09c-4d64-aa1b-80eac2b6b202", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
51862024-12-20T22:20:13.976ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 534.353538ms iteration = 14 status = {}
51872024-12-20T22:20:13.981ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
51882024-12-20T22:20:13.982ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8a5924f1-151a-4ac3-8bea-ca674977038f", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51892024-12-20T22:20:13.982ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51902024-12-20T22:20:13.984ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1960579d-9a12-4dec-ab0c-e2510fa6a8ff", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51912024-12-20T22:20:13.984ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51922024-12-20T22:20:13.986ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2ac34124-0963-41fb-9b5c-33de85b422e3", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51932024-12-20T22:20:13.986ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51942024-12-20T22:20:13.988ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51952024-12-20T22:20:13.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 547.564521ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
51962024-12-20T22:20:14.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51972024-12-20T22:20:14.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51982024-12-20T22:20:14.007ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
51992024-12-20T22:20:14.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52002024-12-20T22:20:14.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52012024-12-20T22:20:14.018ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52022024-12-20T22:20:14.018ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa61bffb-69bf-4572-8a4b-6810920883c5", "content-length": "134", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
52032024-12-20T22:20:14.018ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52042024-12-20T22:20:14.018ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
52052024-12-20T22:20:14.018ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52062024-12-20T22:20:14.018ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52072024-12-20T22:20:14.018ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52082024-12-20T22:20:14.018ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52092024-12-20T22:20:14.018ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52102024-12-20T22:20:14.018ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52112024-12-20T22:20:14.018ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52122024-12-20T22:20:14.019ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52132024-12-20T22:20:14.019ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
52142024-12-20T22:20:14.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52152024-12-20T22:20:14.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52162024-12-20T22:20:14.021ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52172024-12-20T22:20:14.021ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1fe30b9-ca2f-4d91-b91e-204e5770cbf6", "content-length": "2", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
52182024-12-20T22:20:14.021ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52192024-12-20T22:20:14.021ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd162534-46f5-48f4-b0cd-2f3392d257d2", "content-length": "52", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
52202024-12-20T22:20:14.021ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
52212024-12-20T22:20:14.021ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52222024-12-20T22:20:14.123ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d24dd955-80f6-42f5-9319-dc49db0ff609", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
52232024-12-20T22:20:14.123ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
52242024-12-20T22:20:14.123ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52252024-12-20T22:20:14.216ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7aa1a18-dfe2-4af0-b3f4-e540ed81739b", "content-length": "682", "date": "Fri, 20 Dec 2024 22:20:13 GMT"} })
52262024-12-20T22:20:14.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52272024-12-20T22:20:14.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52282024-12-20T22:20:14.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 57837868-2377-4d91-aa1a-884525544fe1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52292024-12-20T22:20:14.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 57837868-2377-4d91-aa1a-884525544fe1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52302024-12-20T22:20:14.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 57837868-2377-4d91-aa1a-884525544fe1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52312024-12-20T22:20:14.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52322024-12-20T22:20:14.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52332024-12-20T22:20:14.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52342024-12-20T22:20:14.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52352024-12-20T22:20:14.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52362024-12-20T22:20:14.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52372024-12-20T22:20:14.234ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 792.409175ms iteration = 13 status = {}
52382024-12-20T22:20:14.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 0b8440c7-8799-45ae-93b4-649d2edc1a76 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
52392024-12-20T22:20:14.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 0b8440c7-8799-45ae-93b4-649d2edc1a76 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
52402024-12-20T22:20:14.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 0b8440c7-8799-45ae-93b4-649d2edc1a76 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
52412024-12-20T22:20:15.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2b650b76-b3a5-480f-b751-cd53fe74fd69 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52422024-12-20T22:20:15.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2b650b76-b3a5-480f-b751-cd53fe74fd69 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52432024-12-20T22:20:15.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2b650b76-b3a5-480f-b751-cd53fe74fd69 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52442024-12-20T22:20:15.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1350 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 80ea234d-dca8-4bd9-b609-24477fb74295 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
52452024-12-20T22:20:16.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9a23d961-4240-4033-9259-a3da56df9e7e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52462024-12-20T22:20:16.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9a23d961-4240-4033-9259-a3da56df9e7e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52472024-12-20T22:20:16.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9a23d961-4240-4033-9259-a3da56df9e7e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52482024-12-20T22:20:17.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 357180f1-2c02-4ddf-9413-8e8078e8bb7d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52492024-12-20T22:20:17.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 357180f1-2c02-4ddf-9413-8e8078e8bb7d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52502024-12-20T22:20:17.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 357180f1-2c02-4ddf-9413-8e8078e8bb7d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52512024-12-20T22:20:18.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dec2ba68-4e38-44d6-93c0-726310330d4a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52522024-12-20T22:20:18.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dec2ba68-4e38-44d6-93c0-726310330d4a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52532024-12-20T22:20:18.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dec2ba68-4e38-44d6-93c0-726310330d4a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52542024-12-20T22:20:19.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 117d2c5d-b667-4d10-a388-24791bf27e1b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52552024-12-20T22:20:19.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 117d2c5d-b667-4d10-a388-24791bf27e1b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52562024-12-20T22:20:19.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 117d2c5d-b667-4d10-a388-24791bf27e1b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52572024-12-20T22:20:20.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7fa2d017-e890-4352-8396-aa8172ef61d2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52582024-12-20T22:20:20.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7fa2d017-e890-4352-8396-aa8172ef61d2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52592024-12-20T22:20:20.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7fa2d017-e890-4352-8396-aa8172ef61d2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52602024-12-20T22:20:21.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d2f08ebc-d2ec-444e-a1f3-be728f061f51 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52612024-12-20T22:20:21.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d2f08ebc-d2ec-444e-a1f3-be728f061f51 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52622024-12-20T22:20:21.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d2f08ebc-d2ec-444e-a1f3-be728f061f51 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52632024-12-20T22:20:22.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ac2909ea-cb19-4d07-8af7-ee252eb7f235 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52642024-12-20T22:20:22.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ac2909ea-cb19-4d07-8af7-ee252eb7f235 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52652024-12-20T22:20:22.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ac2909ea-cb19-4d07-8af7-ee252eb7f235 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52662024-12-20T22:20:23.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = de8e5883-b439-4eeb-a623-1f26eee41a0f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52672024-12-20T22:20:23.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = de8e5883-b439-4eeb-a623-1f26eee41a0f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52682024-12-20T22:20:23.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = de8e5883-b439-4eeb-a623-1f26eee41a0f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52692024-12-20T22:20:23.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
52702024-12-20T22:20:23.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
52712024-12-20T22:20:23.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52722024-12-20T22:20:23.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52732024-12-20T22:20:23.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52742024-12-20T22:20:23.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52752024-12-20T22:20:23.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52762024-12-20T22:20:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52772024-12-20T22:20:23.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52782024-12-20T22:20:23.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.566596ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52792024-12-20T22:20:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52802024-12-20T22:20:23.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52812024-12-20T22:20:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52822024-12-20T22:20:23.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52832024-12-20T22:20:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52842024-12-20T22:20:23.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52852024-12-20T22:20:23.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
52862024-12-20T22:20:23.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52872024-12-20T22:20:23.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52882024-12-20T22:20:23.466ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
52892024-12-20T22:20:23.466ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.579598ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
52902024-12-20T22:20:24.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9f1f5802-33bb-46ae-a6e3-15f634d08e61 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52912024-12-20T22:20:24.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9f1f5802-33bb-46ae-a6e3-15f634d08e61 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52922024-12-20T22:20:24.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9f1f5802-33bb-46ae-a6e3-15f634d08e61 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52932024-12-20T22:20:25.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bec500f8-771f-4206-bc55-0b50113c9693 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52942024-12-20T22:20:25.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bec500f8-771f-4206-bc55-0b50113c9693 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52952024-12-20T22:20:25.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bec500f8-771f-4206-bc55-0b50113c9693 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52962024-12-20T22:20:25.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = e4979b70-b315-4529-a9ad-2982b6eaf51e response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
52972024-12-20T22:20:26.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c5e0fc20-e7f8-4b9a-8959-e470549c781d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52982024-12-20T22:20:26.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c5e0fc20-e7f8-4b9a-8959-e470549c781d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
52992024-12-20T22:20:26.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c5e0fc20-e7f8-4b9a-8959-e470549c781d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53002024-12-20T22:20:27.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a93aa404-234e-47b9-aa94-c46ce46726df roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53012024-12-20T22:20:27.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a93aa404-234e-47b9-aa94-c46ce46726df resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53022024-12-20T22:20:27.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a93aa404-234e-47b9-aa94-c46ce46726df response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53032024-12-20T22:20:28.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 49b4a221-f7fc-4b6d-94cb-58f1f91ed1bb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53042024-12-20T22:20:28.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 49b4a221-f7fc-4b6d-94cb-58f1f91ed1bb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53052024-12-20T22:20:28.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 49b4a221-f7fc-4b6d-94cb-58f1f91ed1bb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53062024-12-20T22:20:29.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d68be7c-8ac1-48a2-b0f8-600a22479063 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53072024-12-20T22:20:29.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d68be7c-8ac1-48a2-b0f8-600a22479063 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53082024-12-20T22:20:29.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d68be7c-8ac1-48a2-b0f8-600a22479063 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53092024-12-20T22:20:30.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a5aa13ce-f0a2-4ff8-9e6f-c1aff4d2470e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53102024-12-20T22:20:30.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a5aa13ce-f0a2-4ff8-9e6f-c1aff4d2470e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53112024-12-20T22:20:30.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a5aa13ce-f0a2-4ff8-9e6f-c1aff4d2470e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53122024-12-20T22:20:31.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2d069ea1-5d60-4bf6-8422-2d0a53b4c57a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53132024-12-20T22:20:31.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2d069ea1-5d60-4bf6-8422-2d0a53b4c57a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53142024-12-20T22:20:31.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2d069ea1-5d60-4bf6-8422-2d0a53b4c57a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53152024-12-20T22:20:32.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6112528a-69b6-43ea-bddb-8c9e39518657 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53162024-12-20T22:20:32.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6112528a-69b6-43ea-bddb-8c9e39518657 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53172024-12-20T22:20:32.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6112528a-69b6-43ea-bddb-8c9e39518657 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53182024-12-20T22:20:33.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
53192024-12-20T22:20:33.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53202024-12-20T22:20:33.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
53212024-12-20T22:20:33.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53222024-12-20T22:20:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53232024-12-20T22:20:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53242024-12-20T22:20:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53252024-12-20T22:20:33.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53262024-12-20T22:20:33.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53272024-12-20T22:20:33.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.061331ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53282024-12-20T22:20:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53292024-12-20T22:20:33.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53302024-12-20T22:20:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53312024-12-20T22:20:33.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53322024-12-20T22:20:33.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53332024-12-20T22:20:33.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53342024-12-20T22:20:33.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
53352024-12-20T22:20:33.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53362024-12-20T22:20:33.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53372024-12-20T22:20:33.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
53382024-12-20T22:20:33.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.642288ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
53392024-12-20T22:20:33.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 299c97d7-e190-4009-8053-3d0905b4157f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53402024-12-20T22:20:33.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 299c97d7-e190-4009-8053-3d0905b4157f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53412024-12-20T22:20:33.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 299c97d7-e190-4009-8053-3d0905b4157f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53422024-12-20T22:20:34.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fe958f7d-ea30-492b-88a8-cce6349461d6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53432024-12-20T22:20:34.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fe958f7d-ea30-492b-88a8-cce6349461d6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53442024-12-20T22:20:34.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fe958f7d-ea30-492b-88a8-cce6349461d6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53452024-12-20T22:20:35.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 002e0ef4-77db-4186-bf02-61a9d4859ccc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53462024-12-20T22:20:35.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 002e0ef4-77db-4186-bf02-61a9d4859ccc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53472024-12-20T22:20:35.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 002e0ef4-77db-4186-bf02-61a9d4859ccc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53482024-12-20T22:20:35.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1469 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 613beabf-b99f-487d-a428-84e70ac1d29c response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
53492024-12-20T22:20:36.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8bf13ecd-2088-4b0b-8968-6f691f6ab4b1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53502024-12-20T22:20:36.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8bf13ecd-2088-4b0b-8968-6f691f6ab4b1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53512024-12-20T22:20:36.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8bf13ecd-2088-4b0b-8968-6f691f6ab4b1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53522024-12-20T22:20:37.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0bed87eb-3e6f-43d8-b639-589785ba8d3f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53532024-12-20T22:20:37.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0bed87eb-3e6f-43d8-b639-589785ba8d3f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53542024-12-20T22:20:37.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0bed87eb-3e6f-43d8-b639-589785ba8d3f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53552024-12-20T22:20:38.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12f076d3-a099-4e22-a44b-54eca1f14ce3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53562024-12-20T22:20:38.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12f076d3-a099-4e22-a44b-54eca1f14ce3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53572024-12-20T22:20:38.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12f076d3-a099-4e22-a44b-54eca1f14ce3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53582024-12-20T22:20:39.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 53e2c304-8043-40b4-ae7b-777dd5985906 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53592024-12-20T22:20:39.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 53e2c304-8043-40b4-ae7b-777dd5985906 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53602024-12-20T22:20:39.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 53e2c304-8043-40b4-ae7b-777dd5985906 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53612024-12-20T22:20:40.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 7a2fa4e3-299f-48d5-82af-8fbc1e0dae35 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
53622024-12-20T22:20:40.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 7a2fa4e3-299f-48d5-82af-8fbc1e0dae35 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
53632024-12-20T22:20:40.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 7a2fa4e3-299f-48d5-82af-8fbc1e0dae35 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
53642024-12-20T22:20:40.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d828efc6-c5fc-460b-8f5d-451378d675ef roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
53652024-12-20T22:20:40.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d828efc6-c5fc-460b-8f5d-451378d675ef resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
53662024-12-20T22:20:40.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d828efc6-c5fc-460b-8f5d-451378d675ef response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
53672024-12-20T22:20:40.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2138ecd-7eb2-4e23-a4a3-16ba542ecbfc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53682024-12-20T22:20:40.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2138ecd-7eb2-4e23-a4a3-16ba542ecbfc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53692024-12-20T22:20:40.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2138ecd-7eb2-4e23-a4a3-16ba542ecbfc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53702024-12-20T22:20:41.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b098caf2-779b-4523-8ac3-41d81bcae872 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53712024-12-20T22:20:41.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b098caf2-779b-4523-8ac3-41d81bcae872 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53722024-12-20T22:20:41.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b098caf2-779b-4523-8ac3-41d81bcae872 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53732024-12-20T22:20:42.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f0e70e8b-b45e-47cc-ad1f-414d7890e98d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53742024-12-20T22:20:42.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f0e70e8b-b45e-47cc-ad1f-414d7890e98d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53752024-12-20T22:20:42.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f0e70e8b-b45e-47cc-ad1f-414d7890e98d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
53762024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
53772024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53782024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
53792024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53802024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53812024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
53822024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
53832024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53842024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53852024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
53862024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53872024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
53882024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53892024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
53902024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
53912024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53922024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
53932024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53942024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
53952024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
53962024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53972024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
53982024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53992024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54002024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
54012024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
54022024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54032024-12-20T22:20:43.441ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
54042024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54052024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54062024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
54072024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54082024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
54092024-12-20T22:20:43.442ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54102024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54112024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54122024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54132024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54142024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54152024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54162024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54172024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54182024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54192024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54202024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54212024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54222024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54232024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54242024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54252024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54262024-12-20T22:20:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54272024-12-20T22:20:43.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.141672ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
54282024-12-20T22:20:43.445ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.91553ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54292024-12-20T22:20:43.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54302024-12-20T22:20:43.447ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54312024-12-20T22:20:43.447ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54322024-12-20T22:20:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54332024-12-20T22:20:43.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54342024-12-20T22:20:43.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54352024-12-20T22:20:43.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54362024-12-20T22:20:43.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54372024-12-20T22:20:43.448ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54382024-12-20T22:20:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54392024-12-20T22:20:43.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54402024-12-20T22:20:43.450ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54412024-12-20T22:20:43.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 379419348 } })
54422024-12-20T22:20:43.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
54432024-12-20T22:20:43.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54442024-12-20T22:20:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54452024-12-20T22:20:43.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54462024-12-20T22:20:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54472024-12-20T22:20:43.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54482024-12-20T22:20:43.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54492024-12-20T22:20:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54502024-12-20T22:20:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54512024-12-20T22:20:43.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54522024-12-20T22:20:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54532024-12-20T22:20:43.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54542024-12-20T22:20:43.457ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 385686761 } })
54552024-12-20T22:20:43.457ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
54562024-12-20T22:20:43.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54572024-12-20T22:20:43.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54582024-12-20T22:20:43.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54592024-12-20T22:20:43.462ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54602024-12-20T22:20:43.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54612024-12-20T22:20:43.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54622024-12-20T22:20:43.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 23.488827ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54632024-12-20T22:20:43.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54642024-12-20T22:20:43.465ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54652024-12-20T22:20:43.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54662024-12-20T22:20:43.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54672024-12-20T22:20:43.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54682024-12-20T22:20:43.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54692024-12-20T22:20:43.468ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54702024-12-20T22:20:43.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54712024-12-20T22:20:43.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54722024-12-20T22:20:43.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54732024-12-20T22:20:43.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54742024-12-20T22:20:43.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54752024-12-20T22:20:43.470ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 398779013 } })
54762024-12-20T22:20:43.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54772024-12-20T22:20:43.470ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
54782024-12-20T22:20:43.483ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54792024-12-20T22:20:43.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54802024-12-20T22:20:43.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54812024-12-20T22:20:43.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54822024-12-20T22:20:43.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54832024-12-20T22:20:43.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
54842024-12-20T22:20:43.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54852024-12-20T22:20:43.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54862024-12-20T22:20:43.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54872024-12-20T22:20:43.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54882024-12-20T22:20:43.496ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54892024-12-20T22:20:43.496ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54902024-12-20T22:20:43.496ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54912024-12-20T22:20:43.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54922024-12-20T22:20:43.505ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.466939ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
54932024-12-20T22:20:43.511ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
54942024-12-20T22:20:43.511ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.57184ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
54952024-12-20T22:20:43.519ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.318118ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54962024-12-20T22:20:43.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54972024-12-20T22:20:43.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54982024-12-20T22:20:43.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54992024-12-20T22:20:43.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55002024-12-20T22:20:43.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55012024-12-20T22:20:43.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
55022024-12-20T22:20:43.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55032024-12-20T22:20:43.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55042024-12-20T22:20:43.527ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.462611ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55052024-12-20T22:20:43.528ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.605851ms iteration = 14 status = 0
55062024-12-20T22:20:43.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55072024-12-20T22:20:43.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55082024-12-20T22:20:43.547ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55092024-12-20T22:20:43.547ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55102024-12-20T22:20:43.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55112024-12-20T22:20:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55122024-12-20T22:20:43.548ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55132024-12-20T22:20:43.548ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.824816ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55142024-12-20T22:20:43.550ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55152024-12-20T22:20:43.550ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55162024-12-20T22:20:43.550ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.896826ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55172024-12-20T22:20:43.554ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55182024-12-20T22:20:43.554ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55192024-12-20T22:20:43.555ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03a13401-0bbf-4478-97e3-c1ac95400057", "content-length": "26", "date": "Fri, 20 Dec 2024 22:20:43 GMT"} })
55202024-12-20T22:20:43.555ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55212024-12-20T22:20:43.558ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55222024-12-20T22:20:43.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.530434ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
55232024-12-20T22:20:43.586ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
55242024-12-20T22:20:43.586ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55252024-12-20T22:20:43.586ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88c9246f-eb17-475d-abe1-a527270bb99f", "content-length": "26", "date": "Fri, 20 Dec 2024 22:20:43 GMT"} })
55262024-12-20T22:20:43.586ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55272024-12-20T22:20:43.588ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
55282024-12-20T22:20:43.590ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55292024-12-20T22:20:43.590ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55302024-12-20T22:20:43.590ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8182135f-8996-4213-91c7-6ecc7575724f", "content-length": "26", "date": "Fri, 20 Dec 2024 22:20:43 GMT"} })
55312024-12-20T22:20:43.590ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55322024-12-20T22:20:43.592ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55332024-12-20T22:20:43.608ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 166.571426ms iteration = 17 status = {"physical_disks_added":0}
55342024-12-20T22:20:43.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55352024-12-20T22:20:43.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55362024-12-20T22:20:43.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55372024-12-20T22:20:43.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55382024-12-20T22:20:43.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55392024-12-20T22:20:43.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55402024-12-20T22:20:43.614ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55412024-12-20T22:20:43.615ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55422024-12-20T22:20:43.615ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55432024-12-20T22:20:43.615ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2a03e3b-3952-41db-9a7d-0e47b0ba9e01", "content-length": "372", "date": "Fri, 20 Dec 2024 22:20:43 GMT"} })
55442024-12-20T22:20:43.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55452024-12-20T22:20:43.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55462024-12-20T22:20:43.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55472024-12-20T22:20:43.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55482024-12-20T22:20:43.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55492024-12-20T22:20:43.660ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
55502024-12-20T22:20:43.660ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55512024-12-20T22:20:43.661ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "54d89f6c-c5f1-40f7-8358-91d2d3f1c7c9", "date": "Fri, 20 Dec 2024 22:20:43 GMT"} })
55522024-12-20T22:20:43.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55532024-12-20T22:20:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55542024-12-20T22:20:43.662ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 220.328878ms iteration = 14 status = {}
55552024-12-20T22:20:43.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55562024-12-20T22:20:43.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55572024-12-20T22:20:43.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55582024-12-20T22:20:43.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55592024-12-20T22:20:43.670ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55602024-12-20T22:20:43.670ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55612024-12-20T22:20:43.670ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "95b14045-86e3-4009-a93f-9dfb4f391947", "date": "Fri, 20 Dec 2024 22:20:43 GMT"} })
55622024-12-20T22:20:43.672ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 230.685482ms iteration = 15 status = {}
55632024-12-20T22:20:43.678ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55642024-12-20T22:20:43.678ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bc5cf95-226c-4ddd-b528-f38be9d2c572", "content-length": "1", "date": "Fri, 20 Dec 2024 22:20:42 GMT"} })
55652024-12-20T22:20:43.679ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55662024-12-20T22:20:43.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55672024-12-20T22:20:43.681ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 240.034096ms iteration = 14 status = null
55682024-12-20T22:20:43.715ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55692024-12-20T22:20:43.715ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "515f26a9-3b1b-42a1-9203-13d7a9afb3ca", "content-length": "691", "date": "Fri, 20 Dec 2024 22:20:43 GMT"} })
55702024-12-20T22:20:43.715ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55712024-12-20T22:20:43.715ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55722024-12-20T22:20:43.715ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55732024-12-20T22:20:43.717ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 276.365481ms iteration = 14 status = {}
55742024-12-20T22:20:43.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55752024-12-20T22:20:43.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55762024-12-20T22:20:43.756ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
55772024-12-20T22:20:43.756ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55782024-12-20T22:20:43.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55792024-12-20T22:20:43.769ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55802024-12-20T22:20:43.769ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "553d3898-7b5a-4310-9256-680588e407be", "content-length": "134", "date": "Fri, 20 Dec 2024 22:20:42 GMT"} })
55812024-12-20T22:20:43.769ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55822024-12-20T22:20:43.769ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
55832024-12-20T22:20:43.770ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55842024-12-20T22:20:43.770ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55852024-12-20T22:20:43.770ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55862024-12-20T22:20:43.770ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55872024-12-20T22:20:43.770ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55882024-12-20T22:20:43.770ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55892024-12-20T22:20:43.770ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55902024-12-20T22:20:43.770ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55912024-12-20T22:20:43.770ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
55922024-12-20T22:20:43.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55932024-12-20T22:20:43.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55942024-12-20T22:20:43.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55952024-12-20T22:20:43.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0caa3446-11b2-4ee8-b8ff-4287e269f1e7", "content-length": "2", "date": "Fri, 20 Dec 2024 22:20:42 GMT"} })
55962024-12-20T22:20:43.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55972024-12-20T22:20:43.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b436050-db28-46d8-816f-08fb5f1de17e", "content-length": "52", "date": "Fri, 20 Dec 2024 22:20:42 GMT"} })
55982024-12-20T22:20:43.773ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
55992024-12-20T22:20:43.773ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56002024-12-20T22:20:43.887ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9becd4e8-6bd8-4866-b536-9a6b540bb70b", "date": "Fri, 20 Dec 2024 22:20:43 GMT"} })
56012024-12-20T22:20:43.887ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
56022024-12-20T22:20:43.887ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56032024-12-20T22:20:43.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 68d4c710-9580-47c6-b32d-1ab6be7f1ff9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56042024-12-20T22:20:43.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 68d4c710-9580-47c6-b32d-1ab6be7f1ff9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56052024-12-20T22:20:43.888ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc15843f-1260-471f-b890-cd1347ccd0c8", "content-length": "682", "date": "Fri, 20 Dec 2024 22:20:43 GMT"} })
56062024-12-20T22:20:43.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56072024-12-20T22:20:43.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56082024-12-20T22:20:43.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 68d4c710-9580-47c6-b32d-1ab6be7f1ff9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56092024-12-20T22:20:43.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56102024-12-20T22:20:43.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56112024-12-20T22:20:43.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56122024-12-20T22:20:43.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56132024-12-20T22:20:43.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56142024-12-20T22:20:43.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56152024-12-20T22:20:43.906ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 464.959369ms iteration = 14 status = {}
56162024-12-20T22:20:44.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ef77b326-fdad-4ad5-b004-84b0b708c4b5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
56172024-12-20T22:20:44.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ef77b326-fdad-4ad5-b004-84b0b708c4b5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
56182024-12-20T22:20:44.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ef77b326-fdad-4ad5-b004-84b0b708c4b5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
56192024-12-20T22:20:44.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 506407d9-c5c1-44a4-818d-b1f9f98e5039 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56202024-12-20T22:20:44.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 506407d9-c5c1-44a4-818d-b1f9f98e5039 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56212024-12-20T22:20:44.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 506407d9-c5c1-44a4-818d-b1f9f98e5039 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56222024-12-20T22:20:45.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1320 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = d8f47fcc-6fb2-438b-be89-22da70627506 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
56232024-12-20T22:20:45.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3c37cc00-ee4a-43a9-876c-1d9d0a850e05 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56242024-12-20T22:20:45.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3c37cc00-ee4a-43a9-876c-1d9d0a850e05 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56252024-12-20T22:20:45.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3c37cc00-ee4a-43a9-876c-1d9d0a850e05 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56262024-12-20T22:20:46.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2ef149b3-c605-4e61-8063-04303f3cdd38 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56272024-12-20T22:20:46.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2ef149b3-c605-4e61-8063-04303f3cdd38 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56282024-12-20T22:20:46.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2ef149b3-c605-4e61-8063-04303f3cdd38 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56292024-12-20T22:20:47.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d24f29fa-5e62-4956-8d68-93f2f4732f1e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56302024-12-20T22:20:47.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d24f29fa-5e62-4956-8d68-93f2f4732f1e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56312024-12-20T22:20:47.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d24f29fa-5e62-4956-8d68-93f2f4732f1e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56322024-12-20T22:20:49.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35a4f1af-9824-47a3-8159-3bdfdbeb9755 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56332024-12-20T22:20:49.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35a4f1af-9824-47a3-8159-3bdfdbeb9755 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56342024-12-20T22:20:49.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35a4f1af-9824-47a3-8159-3bdfdbeb9755 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56352024-12-20T22:20:50.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 99d5cb78-a3cb-4eea-8518-5b78d7e2ffbb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56362024-12-20T22:20:50.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 99d5cb78-a3cb-4eea-8518-5b78d7e2ffbb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56372024-12-20T22:20:50.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 99d5cb78-a3cb-4eea-8518-5b78d7e2ffbb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56382024-12-20T22:20:51.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b401a590-07b7-40c4-80d9-254bba66884c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56392024-12-20T22:20:51.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b401a590-07b7-40c4-80d9-254bba66884c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56402024-12-20T22:20:51.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b401a590-07b7-40c4-80d9-254bba66884c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56412024-12-20T22:20:52.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fdddce4c-ed5a-4bdb-b32a-8376055d2782 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56422024-12-20T22:20:52.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fdddce4c-ed5a-4bdb-b32a-8376055d2782 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56432024-12-20T22:20:52.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fdddce4c-ed5a-4bdb-b32a-8376055d2782 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56442024-12-20T22:20:53.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 402e2904-c3b5-4036-9a27-ca2511220ca6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56452024-12-20T22:20:53.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 402e2904-c3b5-4036-9a27-ca2511220ca6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56462024-12-20T22:20:53.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 402e2904-c3b5-4036-9a27-ca2511220ca6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56472024-12-20T22:20:53.441ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
56482024-12-20T22:20:53.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56492024-12-20T22:20:53.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
56502024-12-20T22:20:53.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56512024-12-20T22:20:53.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56522024-12-20T22:20:53.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56532024-12-20T22:20:53.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56542024-12-20T22:20:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56552024-12-20T22:20:53.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56562024-12-20T22:20:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56572024-12-20T22:20:53.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56582024-12-20T22:20:53.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56592024-12-20T22:20:53.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56602024-12-20T22:20:53.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
56612024-12-20T22:20:53.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56622024-12-20T22:20:53.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56632024-12-20T22:20:53.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
56642024-12-20T22:20:53.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.883801ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
56652024-12-20T22:20:53.471ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56662024-12-20T22:20:53.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56672024-12-20T22:20:53.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.784132ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56682024-12-20T22:20:54.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 68d322fb-a0ae-4b56-98aa-3779219010bf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56692024-12-20T22:20:54.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 68d322fb-a0ae-4b56-98aa-3779219010bf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56702024-12-20T22:20:54.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 68d322fb-a0ae-4b56-98aa-3779219010bf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56712024-12-20T22:20:55.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 553d77fd-147d-49d3-a1f7-6cf34b6bcb83 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56722024-12-20T22:20:55.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 553d77fd-147d-49d3-a1f7-6cf34b6bcb83 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56732024-12-20T22:20:55.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 553d77fd-147d-49d3-a1f7-6cf34b6bcb83 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56742024-12-20T22:20:55.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1459 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 2af15bdf-ef9b-4e23-82aa-01fa97df6daf response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
56752024-12-20T22:20:56.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a67f4e80-c9f1-42c7-8ea5-72e8bb312110 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56762024-12-20T22:20:56.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a67f4e80-c9f1-42c7-8ea5-72e8bb312110 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56772024-12-20T22:20:56.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a67f4e80-c9f1-42c7-8ea5-72e8bb312110 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56782024-12-20T22:20:57.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 91c309f5-c73e-4051-a4fb-3fa1ef78e9a5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56792024-12-20T22:20:57.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 91c309f5-c73e-4051-a4fb-3fa1ef78e9a5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56802024-12-20T22:20:57.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 91c309f5-c73e-4051-a4fb-3fa1ef78e9a5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56812024-12-20T22:20:58.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 71b5073a-55bc-4df0-8883-6e5f8f8d5bde roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56822024-12-20T22:20:58.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 71b5073a-55bc-4df0-8883-6e5f8f8d5bde resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56832024-12-20T22:20:58.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 71b5073a-55bc-4df0-8883-6e5f8f8d5bde response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56842024-12-20T22:20:59.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d55b25e7-9706-463d-87b0-790ea8d934d4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56852024-12-20T22:20:59.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d55b25e7-9706-463d-87b0-790ea8d934d4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56862024-12-20T22:20:59.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d55b25e7-9706-463d-87b0-790ea8d934d4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56872024-12-20T22:21:00.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3eb37f1-482d-434e-a8a2-e678d44a8eb6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56882024-12-20T22:21:00.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3eb37f1-482d-434e-a8a2-e678d44a8eb6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56892024-12-20T22:21:00.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3eb37f1-482d-434e-a8a2-e678d44a8eb6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56902024-12-20T22:21:01.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba0d785d-843c-48c0-aad2-8a63fba55215 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56912024-12-20T22:21:01.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba0d785d-843c-48c0-aad2-8a63fba55215 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56922024-12-20T22:21:01.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba0d785d-843c-48c0-aad2-8a63fba55215 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56932024-12-20T22:21:02.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b809ec08-48bb-4cc2-99b9-118600cca2a4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56942024-12-20T22:21:02.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b809ec08-48bb-4cc2-99b9-118600cca2a4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56952024-12-20T22:21:02.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b809ec08-48bb-4cc2-99b9-118600cca2a4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56962024-12-20T22:21:03.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dc7b5b3f-6b75-425e-85bf-8cf23aa5b852 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56972024-12-20T22:21:03.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dc7b5b3f-6b75-425e-85bf-8cf23aa5b852 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56982024-12-20T22:21:03.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dc7b5b3f-6b75-425e-85bf-8cf23aa5b852 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
56992024-12-20T22:21:03.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
57002024-12-20T22:21:03.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
57012024-12-20T22:21:03.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57022024-12-20T22:21:03.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57032024-12-20T22:21:03.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57042024-12-20T22:21:03.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57052024-12-20T22:21:03.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57062024-12-20T22:21:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57072024-12-20T22:21:03.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57082024-12-20T22:21:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57092024-12-20T22:21:03.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57102024-12-20T22:21:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57112024-12-20T22:21:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57122024-12-20T22:21:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
57132024-12-20T22:21:03.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57142024-12-20T22:21:03.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57152024-12-20T22:21:03.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
57162024-12-20T22:21:03.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.232814ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
57172024-12-20T22:21:03.472ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57182024-12-20T22:21:03.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57192024-12-20T22:21:03.474ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.267904ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57202024-12-20T22:21:04.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f955304a-6665-443d-84be-a3734dffde4b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57212024-12-20T22:21:04.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f955304a-6665-443d-84be-a3734dffde4b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57222024-12-20T22:21:04.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f955304a-6665-443d-84be-a3734dffde4b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57232024-12-20T22:21:05.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 893e3e36-7325-4624-b2d1-b4a8dae6467d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57242024-12-20T22:21:05.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 893e3e36-7325-4624-b2d1-b4a8dae6467d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57252024-12-20T22:21:05.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 893e3e36-7325-4624-b2d1-b4a8dae6467d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57262024-12-20T22:21:05.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1330 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 82dfbe60-0def-460f-a421-dd32d3895d18 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
57272024-12-20T22:21:06.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f237b77e-72bb-4dc7-aa7b-857e9d8714e6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57282024-12-20T22:21:06.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f237b77e-72bb-4dc7-aa7b-857e9d8714e6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57292024-12-20T22:21:06.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f237b77e-72bb-4dc7-aa7b-857e9d8714e6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57302024-12-20T22:21:07.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f33cd4f-c128-4584-95cf-b06aaaed2478 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57312024-12-20T22:21:07.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f33cd4f-c128-4584-95cf-b06aaaed2478 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57322024-12-20T22:21:07.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f33cd4f-c128-4584-95cf-b06aaaed2478 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57332024-12-20T22:21:08.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 042093fe-ec53-4395-8e7b-ba0f2e741d61 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57342024-12-20T22:21:08.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 042093fe-ec53-4395-8e7b-ba0f2e741d61 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57352024-12-20T22:21:08.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 042093fe-ec53-4395-8e7b-ba0f2e741d61 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57362024-12-20T22:21:09.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 41bac081-6f4e-4d60-80d7-f3d267fc6a16 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57372024-12-20T22:21:09.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 41bac081-6f4e-4d60-80d7-f3d267fc6a16 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57382024-12-20T22:21:09.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 41bac081-6f4e-4d60-80d7-f3d267fc6a16 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57392024-12-20T22:21:10.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0cc9d038-32e9-491f-9010-3a112a5162d0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57402024-12-20T22:21:10.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0cc9d038-32e9-491f-9010-3a112a5162d0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57412024-12-20T22:21:10.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0cc9d038-32e9-491f-9010-3a112a5162d0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57422024-12-20T22:21:11.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 60d7f1f0-157c-41bd-be59-977bace95090 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57432024-12-20T22:21:11.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 60d7f1f0-157c-41bd-be59-977bace95090 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57442024-12-20T22:21:11.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 60d7f1f0-157c-41bd-be59-977bace95090 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57452024-12-20T22:21:12.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d347b7f1-8eb4-4818-908b-33fbf8c76d2e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57462024-12-20T22:21:12.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d347b7f1-8eb4-4818-908b-33fbf8c76d2e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57472024-12-20T22:21:12.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d347b7f1-8eb4-4818-908b-33fbf8c76d2e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
57482024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
57492024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
57502024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57512024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
57522024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
57532024-12-20T22:21:13.442ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57542024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
57552024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57562024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57572024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57582024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
57592024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57602024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
57612024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
57622024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57632024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57642024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57652024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
57662024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57672024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57682024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
57692024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57702024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
57712024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57722024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
57732024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57742024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
57752024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57762024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57772024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
57782024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
57792024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
57802024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
57812024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57822024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
57832024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
57842024-12-20T22:21:13.442ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:11:13.442539280 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57852024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57862024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
57872024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
57882024-12-20T22:21:13.442ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57892024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57902024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
57912024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
57922024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57932024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57942024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
57952024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57962024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
57972024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
57982024-12-20T22:21:13.442ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
57992024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.46\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
58002024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
58012024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58022024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
58032024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
58042024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58052024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58062024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
58072024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
58082024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
58092024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58102024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58112024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58122024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58132024-12-20T22:21:13.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58142024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58152024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58162024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58172024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58182024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
58192024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58202024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58212024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58222024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58232024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58242024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58252024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58262024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58272024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58282024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58292024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58302024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58312024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58322024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58332024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58342024-12-20T22:21:13.443ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 371277806 } })
58352024-12-20T22:21:13.443ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 371296706 } })
58362024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
58372024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.353273ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
58382024-12-20T22:21:13.443ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
58392024-12-20T22:21:13.444ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.458155ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
58402024-12-20T22:21:13.446ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 373940883 } })
58412024-12-20T22:21:13.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58422024-12-20T22:21:13.446ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.209742ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58432024-12-20T22:21:13.447ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58442024-12-20T22:21:13.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58452024-12-20T22:21:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58462024-12-20T22:21:13.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 375979134 } })
58472024-12-20T22:21:13.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58482024-12-20T22:21:13.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58492024-12-20T22:21:13.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58502024-12-20T22:21:13.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58512024-12-20T22:21:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58522024-12-20T22:21:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58532024-12-20T22:21:13.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58542024-12-20T22:21:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58552024-12-20T22:21:13.451ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:11:13.442539280 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
58562024-12-20T22:21:13.451ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.310364ms iteration = 8 status = {"expiration":"2024-12-20T22:11:13.442539280Z","pruned":[]}
58572024-12-20T22:21:13.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58582024-12-20T22:21:13.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58592024-12-20T22:21:13.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58602024-12-20T22:21:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58612024-12-20T22:21:13.462ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58622024-12-20T22:21:13.462ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.028171ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
58632024-12-20T22:21:13.462ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58642024-12-20T22:21:13.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58652024-12-20T22:21:13.462ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 20.263224ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
58662024-12-20T22:21:13.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58672024-12-20T22:21:13.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58682024-12-20T22:21:13.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58692024-12-20T22:21:13.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58702024-12-20T22:21:13.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58712024-12-20T22:21:13.466ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 394846163 } })
58722024-12-20T22:21:13.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58732024-12-20T22:21:13.466ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58742024-12-20T22:21:13.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58752024-12-20T22:21:13.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58762024-12-20T22:21:13.467ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
58772024-12-20T22:21:13.469ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58782024-12-20T22:21:13.472ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58792024-12-20T22:21:13.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58802024-12-20T22:21:13.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58812024-12-20T22:21:13.474ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58822024-12-20T22:21:13.474ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 32.011642ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58832024-12-20T22:21:13.518ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58842024-12-20T22:21:13.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58852024-12-20T22:21:13.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58862024-12-20T22:21:13.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 11df45e6-9de2-4e47-9006-62bd423f838c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
58872024-12-20T22:21:13.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 11df45e6-9de2-4e47-9006-62bd423f838c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
58882024-12-20T22:21:13.524ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
58892024-12-20T22:21:13.524ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
58902024-12-20T22:21:13.524ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.799783ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
58912024-12-20T22:21:13.524ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58922024-12-20T22:21:13.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58932024-12-20T22:21:13.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58942024-12-20T22:21:13.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58952024-12-20T22:21:13.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58962024-12-20T22:21:13.525ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58972024-12-20T22:21:13.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58982024-12-20T22:21:13.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58992024-12-20T22:21:13.528ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59002024-12-20T22:21:13.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59012024-12-20T22:21:13.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59022024-12-20T22:21:13.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59032024-12-20T22:21:13.530ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59042024-12-20T22:21:13.530ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59052024-12-20T22:21:13.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59062024-12-20T22:21:13.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59072024-12-20T22:21:13.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59082024-12-20T22:21:13.531ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59092024-12-20T22:21:13.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59102024-12-20T22:21:13.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59112024-12-20T22:21:13.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59122024-12-20T22:21:13.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59132024-12-20T22:21:13.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59142024-12-20T22:21:13.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59152024-12-20T22:21:13.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59162024-12-20T22:21:13.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 96.164498ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
59172024-12-20T22:21:13.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59182024-12-20T22:21:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59192024-12-20T22:21:13.541ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
59202024-12-20T22:21:13.541ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
59212024-12-20T22:21:13.541ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
59222024-12-20T22:21:13.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59232024-12-20T22:21:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59242024-12-20T22:21:13.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59252024-12-20T22:21:13.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59262024-12-20T22:21:13.579ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
59272024-12-20T22:21:13.579ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
59282024-12-20T22:21:13.579ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
59292024-12-20T22:21:13.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59302024-12-20T22:21:13.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59312024-12-20T22:21:13.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59322024-12-20T22:21:13.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59332024-12-20T22:21:13.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
59342024-12-20T22:21:13.660ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59352024-12-20T22:21:13.660ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bbd4fb3-a01f-4f0a-9777-abca7298a5c0", "content-length": "26", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} })
59362024-12-20T22:21:13.660ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59372024-12-20T22:21:13.662ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
59382024-12-20T22:21:13.672ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59392024-12-20T22:21:13.672ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59402024-12-20T22:21:13.672ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "16d17c16-fb07-4077-b5f5-c1f6f6c8542a", "content-length": "372", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} })
59412024-12-20T22:21:13.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59422024-12-20T22:21:13.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59432024-12-20T22:21:13.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 11df45e6-9de2-4e47-9006-62bd423f838c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
59442024-12-20T22:21:13.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59452024-12-20T22:21:13.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59462024-12-20T22:21:13.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59472024-12-20T22:21:13.678ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59482024-12-20T22:21:13.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59492024-12-20T22:21:13.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59502024-12-20T22:21:13.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59512024-12-20T22:21:13.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59522024-12-20T22:21:13.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59532024-12-20T22:21:13.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59542024-12-20T22:21:13.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59552024-12-20T22:21:13.719ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
59562024-12-20T22:21:13.719ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
59572024-12-20T22:21:13.719ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 276.709235ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
59582024-12-20T22:21:13.721ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59592024-12-20T22:21:13.721ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59602024-12-20T22:21:13.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59612024-12-20T22:21:13.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59622024-12-20T22:21:13.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
59632024-12-20T22:21:13.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 280.833057ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59642024-12-20T22:21:13.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59652024-12-20T22:21:13.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59662024-12-20T22:21:13.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59672024-12-20T22:21:13.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59682024-12-20T22:21:13.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 283.007958ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59692024-12-20T22:21:13.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59702024-12-20T22:21:13.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59712024-12-20T22:21:13.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 283.681176ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59722024-12-20T22:21:13.727ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 284.897627ms iteration = 15 status = 0
59732024-12-20T22:21:13.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59742024-12-20T22:21:13.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59752024-12-20T22:21:13.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59762024-12-20T22:21:13.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59772024-12-20T22:21:13.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59782024-12-20T22:21:13.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59792024-12-20T22:21:13.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59802024-12-20T22:21:13.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59812024-12-20T22:21:13.731ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
59822024-12-20T22:21:13.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59832024-12-20T22:21:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
59842024-12-20T22:21:13.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59852024-12-20T22:21:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59862024-12-20T22:21:13.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
59872024-12-20T22:21:13.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59882024-12-20T22:21:13.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59892024-12-20T22:21:13.737ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59902024-12-20T22:21:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59912024-12-20T22:21:13.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59922024-12-20T22:21:13.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59932024-12-20T22:21:13.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59942024-12-20T22:21:13.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59952024-12-20T22:21:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59962024-12-20T22:21:13.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59972024-12-20T22:21:13.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59982024-12-20T22:21:13.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59992024-12-20T22:21:13.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60002024-12-20T22:21:13.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60012024-12-20T22:21:13.745ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60022024-12-20T22:21:13.745ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6478d4be-a3f0-497b-963f-cea87f603c5e", "content-length": "26", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} })
60032024-12-20T22:21:13.745ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60042024-12-20T22:21:13.748ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60052024-12-20T22:21:13.753ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
60062024-12-20T22:21:13.753ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60072024-12-20T22:21:13.754ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bc35e48d-40b6-4c8d-8159-1729fb7ebb6c", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} })
60082024-12-20T22:21:13.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60092024-12-20T22:21:13.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60102024-12-20T22:21:13.756ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
60112024-12-20T22:21:13.756ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 313.398814ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
60122024-12-20T22:21:13.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60132024-12-20T22:21:13.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60142024-12-20T22:21:13.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60152024-12-20T22:21:13.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60162024-12-20T22:21:13.768ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60172024-12-20T22:21:13.769ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60182024-12-20T22:21:13.769ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 326.616987ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60192024-12-20T22:21:13.771ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60202024-12-20T22:21:13.772ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60212024-12-20T22:21:13.772ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60222024-12-20T22:21:13.772ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d6ced11b-a378-468c-ba59-cfff0f6fbeb3", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} })
60232024-12-20T22:21:13.775ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 332.675628ms iteration = 16 status = {}
60242024-12-20T22:21:13.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 342.478767ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
60252024-12-20T22:21:13.788ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60262024-12-20T22:21:13.788ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60272024-12-20T22:21:13.789ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
60282024-12-20T22:21:13.789ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
60292024-12-20T22:21:13.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60302024-12-20T22:21:13.789ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a524e60-c3b0-4f1c-a07c-74f80d04e9aa", "content-length": "26", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} })
60312024-12-20T22:21:13.789ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60322024-12-20T22:21:13.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60332024-12-20T22:21:13.789ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60342024-12-20T22:21:13.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60352024-12-20T22:21:13.792ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60362024-12-20T22:21:13.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60372024-12-20T22:21:13.799ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60382024-12-20T22:21:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60392024-12-20T22:21:13.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60402024-12-20T22:21:13.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60412024-12-20T22:21:13.802ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 359.775631ms iteration = 18 status = {"physical_disks_added":0}
60422024-12-20T22:21:13.803ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
60432024-12-20T22:21:13.803ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
60442024-12-20T22:21:13.803ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
60452024-12-20T22:21:13.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 360.802291ms iteration = 9 status = {"generation":1}
60462024-12-20T22:21:13.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60472024-12-20T22:21:13.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60482024-12-20T22:21:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60492024-12-20T22:21:13.811ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
60502024-12-20T22:21:13.811ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 369.115145ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
60512024-12-20T22:21:13.812ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
60522024-12-20T22:21:13.812ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
60532024-12-20T22:21:13.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60542024-12-20T22:21:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60552024-12-20T22:21:13.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60562024-12-20T22:21:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60572024-12-20T22:21:13.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60582024-12-20T22:21:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60592024-12-20T22:21:13.821ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
60602024-12-20T22:21:13.821ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
60612024-12-20T22:21:13.821ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
60622024-12-20T22:21:13.821ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 379.173366ms iteration = 9 status = {"generation":2}
60632024-12-20T22:21:13.853ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
60642024-12-20T22:21:13.853ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 411.021037ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
60652024-12-20T22:21:13.981ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
60662024-12-20T22:21:13.983ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 541.228967ms iteration = 15 status = {}
60672024-12-20T22:21:14.045ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60682024-12-20T22:21:14.045ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f92e386a-9c7e-49b0-a512-56ad1af204be", "content-length": "1", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} })
60692024-12-20T22:21:14.047ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60702024-12-20T22:21:14.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60712024-12-20T22:21:14.050ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 607.892958ms iteration = 15 status = null
60722024-12-20T22:21:14.062ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60732024-12-20T22:21:14.063ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "986ab504-f745-4199-b28c-769b5f95ac78", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60742024-12-20T22:21:14.063ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60752024-12-20T22:21:14.063ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60762024-12-20T22:21:14.065ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2338312d-ff97-48d7-8952-6caeeb9f747f", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60772024-12-20T22:21:14.065ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60782024-12-20T22:21:14.067ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60792024-12-20T22:21:14.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 625.160512ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
60802024-12-20T22:21:14.070ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "605d81b3-acb4-4af9-b18e-09d4503a26ac", "content-length": "691", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} })
60812024-12-20T22:21:14.070ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
60822024-12-20T22:21:14.070ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
60832024-12-20T22:21:14.070ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
60842024-12-20T22:21:14.071ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 629.609296ms iteration = 15 status = {}
60852024-12-20T22:21:14.091ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60862024-12-20T22:21:14.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a215fbc3-ca7c-4b52-9b1c-215611a511cd", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60872024-12-20T22:21:14.092ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60882024-12-20T22:21:14.094ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8478dcbd-fac0-4a39-a4e5-3fba07a22e0f", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60892024-12-20T22:21:14.094ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60902024-12-20T22:21:14.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "17c1f4a5-9d8e-44d9-bf5f-bf017759b07f", "date": "Fri, 20 Dec 2024 22:21:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60912024-12-20T22:21:14.095ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60922024-12-20T22:21:14.097ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60932024-12-20T22:21:14.097ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 655.121053ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60942024-12-20T22:21:14.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60952024-12-20T22:21:14.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60962024-12-20T22:21:14.125ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
60972024-12-20T22:21:14.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60982024-12-20T22:21:14.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60992024-12-20T22:21:14.135ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61002024-12-20T22:21:14.135ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f52f97ff-dea1-4d02-bb38-513d1ef9f3df", "content-length": "134", "date": "Fri, 20 Dec 2024 22:21:14 GMT"} })
61012024-12-20T22:21:14.135ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
61022024-12-20T22:21:14.135ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
61032024-12-20T22:21:14.135ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61042024-12-20T22:21:14.135ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61052024-12-20T22:21:14.135ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61062024-12-20T22:21:14.135ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61072024-12-20T22:21:14.135ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61082024-12-20T22:21:14.135ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61092024-12-20T22:21:14.135ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61102024-12-20T22:21:14.135ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61112024-12-20T22:21:14.136ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
61122024-12-20T22:21:14.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61132024-12-20T22:21:14.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61142024-12-20T22:21:14.138ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
61152024-12-20T22:21:14.138ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba2e4110-1f4d-4c51-8f1d-d10f2b3ad26c", "content-length": "2", "date": "Fri, 20 Dec 2024 22:21:14 GMT"} })
61162024-12-20T22:21:14.138ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61172024-12-20T22:21:14.138ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c487398d-9c94-484d-bac7-62bcee436cd8", "content-length": "52", "date": "Fri, 20 Dec 2024 22:21:14 GMT"} })
61182024-12-20T22:21:14.138ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
61192024-12-20T22:21:14.138ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61202024-12-20T22:21:14.237ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f4dadd84-d04b-4bf0-ac1e-bee6b17727f0", "date": "Fri, 20 Dec 2024 22:21:14 GMT"} })
61212024-12-20T22:21:14.237ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
61222024-12-20T22:21:14.237ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61232024-12-20T22:21:14.237ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d97798d3-9c02-49eb-a055-075845709a20", "content-length": "682", "date": "Fri, 20 Dec 2024 22:21:14 GMT"} })
61242024-12-20T22:21:14.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61252024-12-20T22:21:14.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61262024-12-20T22:21:14.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61272024-12-20T22:21:14.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61282024-12-20T22:21:14.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61292024-12-20T22:21:14.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61302024-12-20T22:21:14.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61312024-12-20T22:21:14.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61322024-12-20T22:21:14.254ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 812.298575ms iteration = 15 status = {}
61332024-12-20T22:21:14.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff1652c4-fa61-473f-a942-792b8837e270 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61342024-12-20T22:21:14.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff1652c4-fa61-473f-a942-792b8837e270 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61352024-12-20T22:21:14.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff1652c4-fa61-473f-a942-792b8837e270 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61362024-12-20T22:21:14.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = c50199b5-bc7d-4e96-846a-dd3eccb41948 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
61372024-12-20T22:21:14.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = c50199b5-bc7d-4e96-846a-dd3eccb41948 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
61382024-12-20T22:21:14.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = c50199b5-bc7d-4e96-846a-dd3eccb41948 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
61392024-12-20T22:21:15.687ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1477 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 204bed53-8440-4a07-9cff-3517140a398f response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
61402024-12-20T22:21:15.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0bd1816b-1134-4a8d-8bbb-07004de27695 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61412024-12-20T22:21:15.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0bd1816b-1134-4a8d-8bbb-07004de27695 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61422024-12-20T22:21:15.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2722 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0bd1816b-1134-4a8d-8bbb-07004de27695 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61432024-12-20T22:21:16.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b3c3f393-4174-4e09-b112-9edb899db5c0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61442024-12-20T22:21:16.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b3c3f393-4174-4e09-b112-9edb899db5c0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61452024-12-20T22:21:16.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b3c3f393-4174-4e09-b112-9edb899db5c0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61462024-12-20T22:21:17.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9aeff3fe-d6ea-43a6-8043-c76e2747316b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61472024-12-20T22:21:17.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9aeff3fe-d6ea-43a6-8043-c76e2747316b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61482024-12-20T22:21:17.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9aeff3fe-d6ea-43a6-8043-c76e2747316b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61492024-12-20T22:21:18.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b9ba9fb6-9ab6-4b87-a104-921f4185c9be roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61502024-12-20T22:21:18.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b9ba9fb6-9ab6-4b87-a104-921f4185c9be resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61512024-12-20T22:21:18.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b9ba9fb6-9ab6-4b87-a104-921f4185c9be response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61522024-12-20T22:21:19.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3b722690-bb03-4c31-b5a8-8c66ddb0787f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61532024-12-20T22:21:19.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3b722690-bb03-4c31-b5a8-8c66ddb0787f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61542024-12-20T22:21:19.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3b722690-bb03-4c31-b5a8-8c66ddb0787f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61552024-12-20T22:21:20.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 668749dd-5e0a-44f6-a3ef-9eb00ac69c01 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61562024-12-20T22:21:20.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 668749dd-5e0a-44f6-a3ef-9eb00ac69c01 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61572024-12-20T22:21:20.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 668749dd-5e0a-44f6-a3ef-9eb00ac69c01 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61582024-12-20T22:21:21.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ccfaef2a-5049-41a7-9129-5b09db756d4e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61592024-12-20T22:21:21.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ccfaef2a-5049-41a7-9129-5b09db756d4e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61602024-12-20T22:21:21.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ccfaef2a-5049-41a7-9129-5b09db756d4e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61612024-12-20T22:21:22.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 61f660e3-ee24-4dc6-b887-52764f05d22d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61622024-12-20T22:21:22.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 61f660e3-ee24-4dc6-b887-52764f05d22d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61632024-12-20T22:21:22.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 61f660e3-ee24-4dc6-b887-52764f05d22d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61642024-12-20T22:21:23.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
61652024-12-20T22:21:23.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
61662024-12-20T22:21:23.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61672024-12-20T22:21:23.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61682024-12-20T22:21:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61692024-12-20T22:21:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61702024-12-20T22:21:23.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61712024-12-20T22:21:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61722024-12-20T22:21:23.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61732024-12-20T22:21:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61742024-12-20T22:21:23.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61752024-12-20T22:21:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61762024-12-20T22:21:23.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61772024-12-20T22:21:23.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
61782024-12-20T22:21:23.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61792024-12-20T22:21:23.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61802024-12-20T22:21:23.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
61812024-12-20T22:21:23.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.167214ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
61822024-12-20T22:21:23.471ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61832024-12-20T22:21:23.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61842024-12-20T22:21:23.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.417877ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61852024-12-20T22:21:23.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9f438e3f-6e5f-4c54-adb9-e047201139d5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61862024-12-20T22:21:23.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9f438e3f-6e5f-4c54-adb9-e047201139d5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61872024-12-20T22:21:23.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9f438e3f-6e5f-4c54-adb9-e047201139d5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61882024-12-20T22:21:24.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d2778978-1361-41e9-b355-e73927c45649 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61892024-12-20T22:21:24.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d2778978-1361-41e9-b355-e73927c45649 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61902024-12-20T22:21:24.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d2778978-1361-41e9-b355-e73927c45649 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61912024-12-20T22:21:25.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1441 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = d1bb1858-9764-4b3f-a6fe-28c5e076310d response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
61922024-12-20T22:21:25.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b56834ea-2444-482f-92ec-27008807cf4e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61932024-12-20T22:21:25.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b56834ea-2444-482f-92ec-27008807cf4e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61942024-12-20T22:21:25.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b56834ea-2444-482f-92ec-27008807cf4e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61952024-12-20T22:21:26.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 476af89b-54a6-4b53-954d-ef19ee527e85 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61962024-12-20T22:21:26.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 476af89b-54a6-4b53-954d-ef19ee527e85 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61972024-12-20T22:21:26.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 476af89b-54a6-4b53-954d-ef19ee527e85 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61982024-12-20T22:21:27.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d94e1db2-e31a-43d2-9c6b-b8735ccaf518 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
61992024-12-20T22:21:27.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d94e1db2-e31a-43d2-9c6b-b8735ccaf518 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62002024-12-20T22:21:27.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d94e1db2-e31a-43d2-9c6b-b8735ccaf518 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62012024-12-20T22:21:29.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ec7ed0d7-2cb3-4f6e-ac04-46aa475c7003 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62022024-12-20T22:21:29.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ec7ed0d7-2cb3-4f6e-ac04-46aa475c7003 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62032024-12-20T22:21:29.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ec7ed0d7-2cb3-4f6e-ac04-46aa475c7003 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62042024-12-20T22:21:30.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8a7631b9-a06f-4852-b045-9d434b25f79e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62052024-12-20T22:21:30.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8a7631b9-a06f-4852-b045-9d434b25f79e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62062024-12-20T22:21:30.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8a7631b9-a06f-4852-b045-9d434b25f79e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62072024-12-20T22:21:31.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bfda7da5-ccd0-4e8d-b0ab-abde32dc4e59 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62082024-12-20T22:21:31.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bfda7da5-ccd0-4e8d-b0ab-abde32dc4e59 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62092024-12-20T22:21:31.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bfda7da5-ccd0-4e8d-b0ab-abde32dc4e59 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62102024-12-20T22:21:32.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 30c2909e-e67d-4a6c-80f4-ecbd5309d10a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62112024-12-20T22:21:32.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 30c2909e-e67d-4a6c-80f4-ecbd5309d10a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62122024-12-20T22:21:32.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 30c2909e-e67d-4a6c-80f4-ecbd5309d10a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62132024-12-20T22:21:33.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 530b5a0b-6f4a-489b-9093-1c3b59de5454 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62142024-12-20T22:21:33.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 530b5a0b-6f4a-489b-9093-1c3b59de5454 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62152024-12-20T22:21:33.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 530b5a0b-6f4a-489b-9093-1c3b59de5454 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62162024-12-20T22:21:33.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
62172024-12-20T22:21:33.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
62182024-12-20T22:21:33.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62192024-12-20T22:21:33.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62202024-12-20T22:21:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62212024-12-20T22:21:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62222024-12-20T22:21:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62232024-12-20T22:21:33.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62242024-12-20T22:21:33.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62252024-12-20T22:21:33.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62262024-12-20T22:21:33.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62272024-12-20T22:21:33.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62282024-12-20T22:21:33.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62292024-12-20T22:21:33.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62302024-12-20T22:21:33.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62312024-12-20T22:21:33.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
62322024-12-20T22:21:33.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62332024-12-20T22:21:33.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62342024-12-20T22:21:33.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
62352024-12-20T22:21:33.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.411335ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
62362024-12-20T22:21:33.478ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.286745ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62372024-12-20T22:21:34.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15b4d7ac-7483-4ab9-b830-37688c024784 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62382024-12-20T22:21:34.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15b4d7ac-7483-4ab9-b830-37688c024784 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62392024-12-20T22:21:34.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15b4d7ac-7483-4ab9-b830-37688c024784 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62402024-12-20T22:21:35.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fbae8416-a98a-4be7-ab2b-d8d0ad96aa65 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62412024-12-20T22:21:35.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fbae8416-a98a-4be7-ab2b-d8d0ad96aa65 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62422024-12-20T22:21:35.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fbae8416-a98a-4be7-ab2b-d8d0ad96aa65 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62432024-12-20T22:21:35.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1288 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 52eeda24-575f-43b5-8362-fb2254b5c170 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
62442024-12-20T22:21:36.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2e16e6a-789c-4f41-bad3-93b1e1ed86eb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62452024-12-20T22:21:36.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2e16e6a-789c-4f41-bad3-93b1e1ed86eb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62462024-12-20T22:21:36.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2e16e6a-789c-4f41-bad3-93b1e1ed86eb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62472024-12-20T22:21:37.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e37027d3-897e-4023-9780-9134ff062ba8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62482024-12-20T22:21:37.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e37027d3-897e-4023-9780-9134ff062ba8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62492024-12-20T22:21:37.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e37027d3-897e-4023-9780-9134ff062ba8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62502024-12-20T22:21:38.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 86bbaf19-9181-4607-8e7f-7dce751b0f0e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62512024-12-20T22:21:38.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 86bbaf19-9181-4607-8e7f-7dce751b0f0e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62522024-12-20T22:21:38.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 86bbaf19-9181-4607-8e7f-7dce751b0f0e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62532024-12-20T22:21:39.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 166eb2d7-1cc0-4c0c-a3e5-7fa7e8853495 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62542024-12-20T22:21:39.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 166eb2d7-1cc0-4c0c-a3e5-7fa7e8853495 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62552024-12-20T22:21:39.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 166eb2d7-1cc0-4c0c-a3e5-7fa7e8853495 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62562024-12-20T22:21:40.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 110b931f-b077-4ed0-9a7e-0e8a761f2d49 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62572024-12-20T22:21:40.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 110b931f-b077-4ed0-9a7e-0e8a761f2d49 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62582024-12-20T22:21:40.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 110b931f-b077-4ed0-9a7e-0e8a761f2d49 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62592024-12-20T22:21:41.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 01c6ceba-538b-4b4c-9d98-31ff409650eb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62602024-12-20T22:21:41.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 01c6ceba-538b-4b4c-9d98-31ff409650eb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62612024-12-20T22:21:41.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 01c6ceba-538b-4b4c-9d98-31ff409650eb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62622024-12-20T22:21:41.321ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38442
62632024-12-20T22:21:41.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38442 req_id = fba2022d-9fb4-46c0-b9a7-4fde22f48674 roles = RoleSet { roles: {} } uri = /metrics/producers
62642024-12-20T22:21:41.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38442 req_id = fba2022d-9fb4-46c0-b9a7-4fde22f48674 resource = Database result = Ok(()) uri = /metrics/producers
62652024-12-20T22:21:41.361ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 409c06a2-2340-44a9-a04f-6817610bd642
62662024-12-20T22:21:41.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40471 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38442 req_id = fba2022d-9fb4-46c0-b9a7-4fde22f48674 response_code = 201 uri = /metrics/producers
62672024-12-20T22:21:42.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e62444cc-0a88-46ee-9c40-bbe71cadb495 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62682024-12-20T22:21:42.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e62444cc-0a88-46ee-9c40-bbe71cadb495 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62692024-12-20T22:21:42.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e62444cc-0a88-46ee-9c40-bbe71cadb495 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62702024-12-20T22:21:42.315ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56492
62712024-12-20T22:21:42.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56492 req_id = 7266f3c5-bfb5-40bb-baa2-f1119228690b roles = RoleSet { roles: {} } uri = /metrics/producers
62722024-12-20T22:21:42.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56492 req_id = 7266f3c5-bfb5-40bb-baa2-f1119228690b resource = Database result = Ok(()) uri = /metrics/producers
62732024-12-20T22:21:42.360ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 1cf20796-1e8a-4632-b82f-1c78cae2c84a
62742024-12-20T22:21:42.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45341 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56492 req_id = 7266f3c5-bfb5-40bb-baa2-f1119228690b response_code = 201 uri = /metrics/producers
62752024-12-20T22:21:43.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 68ec8c06-7d14-4ba6-871c-59ae9a3f3031 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62762024-12-20T22:21:43.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 68ec8c06-7d14-4ba6-871c-59ae9a3f3031 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62772024-12-20T22:21:43.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 68ec8c06-7d14-4ba6-871c-59ae9a3f3031 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
62782024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
62792024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62802024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
62812024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62822024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62832024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
62842024-12-20T22:21:43.442ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62852024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62862024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
62872024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
62882024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62892024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62902024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
62912024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62922024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
62932024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
62942024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
62952024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62962024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
62972024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62982024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
62992024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
63002024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63012024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
63022024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63032024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
63042024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63052024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
63062024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
63072024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
63082024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
63092024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63102024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63112024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
63122024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
63132024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63142024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63152024-12-20T22:21:43.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63162024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63172024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63182024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63192024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63202024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63212024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
63222024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
63232024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63242024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63252024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63262024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63272024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63282024-12-20T22:21:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63292024-12-20T22:21:43.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63302024-12-20T22:21:43.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63312024-12-20T22:21:43.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63322024-12-20T22:21:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63332024-12-20T22:21:43.446ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.446294ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63342024-12-20T22:21:43.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63352024-12-20T22:21:43.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63362024-12-20T22:21:43.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63372024-12-20T22:21:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63382024-12-20T22:21:43.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63392024-12-20T22:21:43.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63402024-12-20T22:21:43.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63412024-12-20T22:21:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63422024-12-20T22:21:43.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63432024-12-20T22:21:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63442024-12-20T22:21:43.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.269463ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
63452024-12-20T22:21:43.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63462024-12-20T22:21:43.461ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 389430369 } })
63472024-12-20T22:21:43.462ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
63482024-12-20T22:21:43.462ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 390098086 } })
63492024-12-20T22:21:43.462ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
63502024-12-20T22:21:43.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63512024-12-20T22:21:43.463ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63522024-12-20T22:21:43.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63532024-12-20T22:21:43.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 23.315685ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63542024-12-20T22:21:43.467ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63552024-12-20T22:21:43.467ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 395094616 } })
63562024-12-20T22:21:43.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63572024-12-20T22:21:43.467ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63582024-12-20T22:21:43.467ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
63592024-12-20T22:21:43.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63602024-12-20T22:21:43.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63612024-12-20T22:21:43.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63622024-12-20T22:21:43.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63632024-12-20T22:21:43.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63642024-12-20T22:21:43.498ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63652024-12-20T22:21:43.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63662024-12-20T22:21:43.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63672024-12-20T22:21:43.500ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63682024-12-20T22:21:43.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63692024-12-20T22:21:43.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63702024-12-20T22:21:43.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63712024-12-20T22:21:43.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63722024-12-20T22:21:43.503ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63732024-12-20T22:21:43.503ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63742024-12-20T22:21:43.503ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63752024-12-20T22:21:43.503ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63762024-12-20T22:21:43.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63772024-12-20T22:21:43.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63782024-12-20T22:21:43.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63792024-12-20T22:21:43.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63802024-12-20T22:21:43.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.443609ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
63812024-12-20T22:21:43.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63822024-12-20T22:21:43.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63832024-12-20T22:21:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63842024-12-20T22:21:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63852024-12-20T22:21:43.513ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63862024-12-20T22:21:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63872024-12-20T22:21:43.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63882024-12-20T22:21:43.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63892024-12-20T22:21:43.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63902024-12-20T22:21:43.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63912024-12-20T22:21:43.530ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63922024-12-20T22:21:43.530ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.341239ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63932024-12-20T22:21:43.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63942024-12-20T22:21:43.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63952024-12-20T22:21:43.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63962024-12-20T22:21:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
63972024-12-20T22:21:43.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63982024-12-20T22:21:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63992024-12-20T22:21:43.552ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64002024-12-20T22:21:43.553ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64012024-12-20T22:21:43.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64022024-12-20T22:21:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64032024-12-20T22:21:43.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.112018ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64042024-12-20T22:21:43.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64052024-12-20T22:21:43.559ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
64062024-12-20T22:21:43.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 116.849056ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
64072024-12-20T22:21:43.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64082024-12-20T22:21:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64092024-12-20T22:21:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
64102024-12-20T22:21:43.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64112024-12-20T22:21:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64122024-12-20T22:21:43.562ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.642664ms iteration = 16 status = 0
64132024-12-20T22:21:43.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.784176ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64142024-12-20T22:21:43.569ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64152024-12-20T22:21:43.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64162024-12-20T22:21:43.573ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64172024-12-20T22:21:43.573ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64182024-12-20T22:21:43.573ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc768401-1746-4114-b4ef-28bc0b9ceb9b", "content-length": "26", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
64192024-12-20T22:21:43.573ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64202024-12-20T22:21:43.574ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
64212024-12-20T22:21:43.574ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64222024-12-20T22:21:43.574ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "359fcf59-7760-4186-9bc8-7ed96f4baa80", "content-length": "26", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
64232024-12-20T22:21:43.574ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64242024-12-20T22:21:43.574ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64252024-12-20T22:21:43.574ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64262024-12-20T22:21:43.574ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1600cb9d-004d-4e9d-97a4-a615fa5a17be", "content-length": "26", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
64272024-12-20T22:21:43.574ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64282024-12-20T22:21:43.576ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64292024-12-20T22:21:43.576ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64302024-12-20T22:21:43.576ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
64312024-12-20T22:21:43.587ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64322024-12-20T22:21:43.587ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64332024-12-20T22:21:43.587ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.402484ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64342024-12-20T22:21:43.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.542685ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
64352024-12-20T22:21:43.592ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 150.518374ms iteration = 19 status = {"physical_disks_added":0}
64362024-12-20T22:21:43.629ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:62590
64372024-12-20T22:21:43.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62590 req_id = 37db24d0-f783-428b-997f-0282679aefde roles = RoleSet { roles: {} } uri = /metrics/producers
64382024-12-20T22:21:43.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62590 req_id = 37db24d0-f783-428b-997f-0282679aefde resource = Database result = Ok(()) uri = /metrics/producers
64392024-12-20T22:21:43.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64402024-12-20T22:21:43.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64412024-12-20T22:21:43.678ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 99b0250f-bcf3-46ae-aea9-2bb2360d90eb
64422024-12-20T22:21:43.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49484 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62590 req_id = 37db24d0-f783-428b-997f-0282679aefde response_code = 201 uri = /metrics/producers
64432024-12-20T22:21:43.683ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64442024-12-20T22:21:43.684ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "87746728-4b15-4bc0-890e-fb843e28f05f", "content-length": "1", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
64452024-12-20T22:21:43.685ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64462024-12-20T22:21:43.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64472024-12-20T22:21:43.686ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64482024-12-20T22:21:43.686ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64492024-12-20T22:21:43.686ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae06c754-8050-454c-8858-424eac8b43f1", "content-length": "372", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
64502024-12-20T22:21:43.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64512024-12-20T22:21:43.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64522024-12-20T22:21:43.687ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 245.48268ms iteration = 16 status = null
64532024-12-20T22:21:43.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64542024-12-20T22:21:43.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64552024-12-20T22:21:43.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64562024-12-20T22:21:43.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64572024-12-20T22:21:43.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64582024-12-20T22:21:43.700ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64592024-12-20T22:21:43.700ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64602024-12-20T22:21:43.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64612024-12-20T22:21:43.735ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64622024-12-20T22:21:43.735ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64632024-12-20T22:21:43.736ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "02973df9-33de-4051-ad73-e08bd61eb09e", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
64642024-12-20T22:21:43.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64652024-12-20T22:21:43.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64662024-12-20T22:21:43.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64672024-12-20T22:21:43.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64682024-12-20T22:21:43.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64692024-12-20T22:21:43.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64702024-12-20T22:21:43.744ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64712024-12-20T22:21:43.744ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64722024-12-20T22:21:43.744ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bb05e903-3386-4c1c-b0ab-1aca05ba286f", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
64732024-12-20T22:21:43.746ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 304.262072ms iteration = 17 status = {}
64742024-12-20T22:21:43.763ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 320.89875ms iteration = 16 status = {}
64752024-12-20T22:21:43.850ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64762024-12-20T22:21:43.850ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c628a88-c805-46e6-9350-6ab728e04f8a", "content-length": "691", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
64772024-12-20T22:21:43.850ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
64782024-12-20T22:21:43.850ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
64792024-12-20T22:21:43.850ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
64802024-12-20T22:21:43.851ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 409.544021ms iteration = 16 status = {}
64812024-12-20T22:21:43.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64822024-12-20T22:21:43.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64832024-12-20T22:21:43.859ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
64842024-12-20T22:21:43.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64852024-12-20T22:21:43.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64862024-12-20T22:21:43.870ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64872024-12-20T22:21:43.871ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "92c35e07-94b5-4860-affc-e72900137469", "content-length": "134", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
64882024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64892024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
64902024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64912024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64922024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64932024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64942024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64952024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64962024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64972024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64982024-12-20T22:21:43.871ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
64992024-12-20T22:21:43.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65002024-12-20T22:21:43.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65012024-12-20T22:21:43.875ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65022024-12-20T22:21:43.875ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b3e9359-d668-42e6-95df-10efb49342ba", "content-length": "2", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
65032024-12-20T22:21:43.875ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65042024-12-20T22:21:43.876ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "74bc561c-e984-4803-a90e-72f75e8df4db", "content-length": "52", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
65052024-12-20T22:21:43.876ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
65062024-12-20T22:21:43.876ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65072024-12-20T22:21:44.073ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9ab0edca-4223-413f-9f89-04a2bd1d4f7d", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
65082024-12-20T22:21:44.073ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
65092024-12-20T22:21:44.073ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65102024-12-20T22:21:44.078ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9310a89-4660-430a-917c-3d9191390dcc", "content-length": "682", "date": "Fri, 20 Dec 2024 22:21:43 GMT"} })
65112024-12-20T22:21:44.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65122024-12-20T22:21:44.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65132024-12-20T22:21:44.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65142024-12-20T22:21:44.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65152024-12-20T22:21:44.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65162024-12-20T22:21:44.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65172024-12-20T22:21:44.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65182024-12-20T22:21:44.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65192024-12-20T22:21:44.095ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 653.201343ms iteration = 16 status = {}
65202024-12-20T22:21:44.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ce5f2e71-974f-4a69-9bb5-4c40a01b52ef roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65212024-12-20T22:21:44.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ce5f2e71-974f-4a69-9bb5-4c40a01b52ef resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65222024-12-20T22:21:44.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ce5f2e71-974f-4a69-9bb5-4c40a01b52ef response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65232024-12-20T22:21:44.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ed5c6c5f-ffec-41f4-b596-c2dd42436d14 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
65242024-12-20T22:21:44.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ed5c6c5f-ffec-41f4-b596-c2dd42436d14 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
65252024-12-20T22:21:44.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = ed5c6c5f-ffec-41f4-b596-c2dd42436d14 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
65262024-12-20T22:21:45.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 51046590-adad-4cfa-9dc0-7c1f3af43ecf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65272024-12-20T22:21:45.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 51046590-adad-4cfa-9dc0-7c1f3af43ecf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65282024-12-20T22:21:45.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 51046590-adad-4cfa-9dc0-7c1f3af43ecf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65292024-12-20T22:21:45.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1287 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = e1b61b6b-5b23-49f9-b1c2-0235ba292f56 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
65302024-12-20T22:21:46.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 74d3d057-2783-4543-ab6c-eb164fc76429 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65312024-12-20T22:21:46.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 74d3d057-2783-4543-ab6c-eb164fc76429 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65322024-12-20T22:21:46.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 74d3d057-2783-4543-ab6c-eb164fc76429 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65332024-12-20T22:21:47.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af6d4f2a-6aa2-4422-8c6d-1a2f04e2eb85 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65342024-12-20T22:21:47.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af6d4f2a-6aa2-4422-8c6d-1a2f04e2eb85 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65352024-12-20T22:21:47.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af6d4f2a-6aa2-4422-8c6d-1a2f04e2eb85 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65362024-12-20T22:21:47.674ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43552
65372024-12-20T22:21:47.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43552 req_id = a2305f92-a436-46a0-bab6-b1cfe054e0d2 roles = RoleSet { roles: {} } uri = /metrics/producers
65382024-12-20T22:21:47.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43552 req_id = a2305f92-a436-46a0-bab6-b1cfe054e0d2 resource = Database result = Ok(()) uri = /metrics/producers
65392024-12-20T22:21:47.714ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 03760c77-b0c3-42eb-a705-bfee77be2fbe
65402024-12-20T22:21:47.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40118 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43552 req_id = a2305f92-a436-46a0-bab6-b1cfe054e0d2 response_code = 201 uri = /metrics/producers
65412024-12-20T22:21:48.247ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:64029
65422024-12-20T22:21:48.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64029 req_id = ab8eeb99-95d1-4a73-9a10-284d6c70db7f roles = RoleSet { roles: {} } uri = /metrics/producers
65432024-12-20T22:21:48.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64029 req_id = ab8eeb99-95d1-4a73-9a10-284d6c70db7f resource = Database result = Ok(()) uri = /metrics/producers
65442024-12-20T22:21:48.287ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = a0a780c3-0806-4044-8e4b-e91bf0405221
65452024-12-20T22:21:48.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40633 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64029 req_id = ab8eeb99-95d1-4a73-9a10-284d6c70db7f response_code = 201 uri = /metrics/producers
65462024-12-20T22:21:48.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 61e34dd1-784c-492a-8447-27fd881c448a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65472024-12-20T22:21:48.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 61e34dd1-784c-492a-8447-27fd881c448a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65482024-12-20T22:21:48.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 61e34dd1-784c-492a-8447-27fd881c448a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65492024-12-20T22:21:48.882ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:61046
65502024-12-20T22:21:48.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61046 req_id = bb02d4cc-7a32-42e8-88b7-5086c5c64223 roles = RoleSet { roles: {} } uri = /metrics/producers
65512024-12-20T22:21:48.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61046 req_id = bb02d4cc-7a32-42e8-88b7-5086c5c64223 resource = Database result = Ok(()) uri = /metrics/producers
65522024-12-20T22:21:48.920ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 7f6e5691-338a-4d1e-8ab4-9564fc795162
65532024-12-20T22:21:48.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37636 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61046 req_id = bb02d4cc-7a32-42e8-88b7-5086c5c64223 response_code = 201 uri = /metrics/producers
65542024-12-20T22:21:49.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = df340d25-5fad-4167-ac03-56a69fc653b8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65552024-12-20T22:21:49.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = df340d25-5fad-4167-ac03-56a69fc653b8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65562024-12-20T22:21:49.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = df340d25-5fad-4167-ac03-56a69fc653b8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65572024-12-20T22:21:50.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f4d6c434-6e4a-44a0-bfc7-7f64e75434d6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65582024-12-20T22:21:50.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f4d6c434-6e4a-44a0-bfc7-7f64e75434d6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65592024-12-20T22:21:50.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f4d6c434-6e4a-44a0-bfc7-7f64e75434d6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65602024-12-20T22:21:51.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ae17e6f6-5acc-42f0-a29d-d90bf6f84637 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65612024-12-20T22:21:51.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ae17e6f6-5acc-42f0-a29d-d90bf6f84637 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65622024-12-20T22:21:51.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ae17e6f6-5acc-42f0-a29d-d90bf6f84637 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65632024-12-20T22:21:52.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6cfd56d-ffb3-485d-b014-eb358bdfc206 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65642024-12-20T22:21:52.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6cfd56d-ffb3-485d-b014-eb358bdfc206 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65652024-12-20T22:21:52.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6cfd56d-ffb3-485d-b014-eb358bdfc206 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65662024-12-20T22:21:53.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
65672024-12-20T22:21:53.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
65682024-12-20T22:21:53.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65692024-12-20T22:21:53.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65702024-12-20T22:21:53.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65712024-12-20T22:21:53.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65722024-12-20T22:21:53.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65732024-12-20T22:21:53.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65742024-12-20T22:21:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65752024-12-20T22:21:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65762024-12-20T22:21:53.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65772024-12-20T22:21:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65782024-12-20T22:21:53.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65792024-12-20T22:21:53.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65802024-12-20T22:21:53.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65812024-12-20T22:21:53.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
65822024-12-20T22:21:53.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65832024-12-20T22:21:53.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65842024-12-20T22:21:53.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
65852024-12-20T22:21:53.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.377005ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
65862024-12-20T22:21:53.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.83795ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65872024-12-20T22:21:53.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ec0f420d-507c-4451-b1f2-f398f3b45df2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65882024-12-20T22:21:53.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ec0f420d-507c-4451-b1f2-f398f3b45df2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65892024-12-20T22:21:53.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ec0f420d-507c-4451-b1f2-f398f3b45df2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65902024-12-20T22:21:54.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9abcae9-b5dc-4518-8fd7-09186562f930 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65912024-12-20T22:21:54.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9abcae9-b5dc-4518-8fd7-09186562f930 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65922024-12-20T22:21:54.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9abcae9-b5dc-4518-8fd7-09186562f930 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65932024-12-20T22:21:55.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d1d9e7ec-faa4-432b-bb39-d974df198d9c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65942024-12-20T22:21:55.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d1d9e7ec-faa4-432b-bb39-d974df198d9c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65952024-12-20T22:21:55.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d1d9e7ec-faa4-432b-bb39-d974df198d9c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65962024-12-20T22:21:55.689ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1806 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 3a276312-66e2-4d24-ba0e-e8681f7b796b response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
65972024-12-20T22:21:56.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1aacd372-6c8d-4f1c-8f22-2490399e905d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65982024-12-20T22:21:56.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1aacd372-6c8d-4f1c-8f22-2490399e905d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
65992024-12-20T22:21:56.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1aacd372-6c8d-4f1c-8f22-2490399e905d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66002024-12-20T22:21:57.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12e235fc-dfba-4139-b4e2-24a1b52a958c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66012024-12-20T22:21:57.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12e235fc-dfba-4139-b4e2-24a1b52a958c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66022024-12-20T22:21:57.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12e235fc-dfba-4139-b4e2-24a1b52a958c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66032024-12-20T22:21:58.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0710c6a6-b6a0-4b25-b156-f0ac94f28fe6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66042024-12-20T22:21:58.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0710c6a6-b6a0-4b25-b156-f0ac94f28fe6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66052024-12-20T22:21:58.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0710c6a6-b6a0-4b25-b156-f0ac94f28fe6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66062024-12-20T22:21:59.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a47f4372-3d89-46ba-bfbf-038271d4a22e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66072024-12-20T22:21:59.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a47f4372-3d89-46ba-bfbf-038271d4a22e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66082024-12-20T22:21:59.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a47f4372-3d89-46ba-bfbf-038271d4a22e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66092024-12-20T22:22:00.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6310c0d-4643-4d2c-bea2-004160b4452e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66102024-12-20T22:22:00.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6310c0d-4643-4d2c-bea2-004160b4452e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66112024-12-20T22:22:00.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6310c0d-4643-4d2c-bea2-004160b4452e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66122024-12-20T22:22:01.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 70be5c6b-1a71-4ceb-98cd-3ee9987fae1a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66132024-12-20T22:22:01.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 70be5c6b-1a71-4ceb-98cd-3ee9987fae1a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66142024-12-20T22:22:01.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 70be5c6b-1a71-4ceb-98cd-3ee9987fae1a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66152024-12-20T22:22:02.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a8c1af4a-f7f7-47fb-ace1-1db3c68e8d0d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66162024-12-20T22:22:02.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a8c1af4a-f7f7-47fb-ace1-1db3c68e8d0d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66172024-12-20T22:22:02.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a8c1af4a-f7f7-47fb-ace1-1db3c68e8d0d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66182024-12-20T22:22:03.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
66192024-12-20T22:22:03.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66202024-12-20T22:22:03.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
66212024-12-20T22:22:03.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66222024-12-20T22:22:03.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66232024-12-20T22:22:03.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66242024-12-20T22:22:03.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66252024-12-20T22:22:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66262024-12-20T22:22:03.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66272024-12-20T22:22:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66282024-12-20T22:22:03.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66292024-12-20T22:22:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66302024-12-20T22:22:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66312024-12-20T22:22:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66322024-12-20T22:22:03.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66332024-12-20T22:22:03.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
66342024-12-20T22:22:03.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66352024-12-20T22:22:03.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66362024-12-20T22:22:03.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
66372024-12-20T22:22:03.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.705609ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
66382024-12-20T22:22:03.473ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.214174ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66392024-12-20T22:22:03.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 212a05bb-e6ed-4091-8744-cc40708130b6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66402024-12-20T22:22:03.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 212a05bb-e6ed-4091-8744-cc40708130b6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66412024-12-20T22:22:03.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 212a05bb-e6ed-4091-8744-cc40708130b6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66422024-12-20T22:22:04.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c173268f-8542-4f8b-aacf-8ab1978fd277 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66432024-12-20T22:22:04.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c173268f-8542-4f8b-aacf-8ab1978fd277 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66442024-12-20T22:22:04.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c173268f-8542-4f8b-aacf-8ab1978fd277 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66452024-12-20T22:22:05.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 651c7bc7-2606-4f4e-9fe4-127ab4740b93 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
66462024-12-20T22:22:05.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ccc998f6-09db-49c0-8c10-77793ea143b1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66472024-12-20T22:22:05.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ccc998f6-09db-49c0-8c10-77793ea143b1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66482024-12-20T22:22:05.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ccc998f6-09db-49c0-8c10-77793ea143b1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66492024-12-20T22:22:06.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 82f5b5a2-cf9f-4439-9b96-349d5d7b7b58 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66502024-12-20T22:22:06.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 82f5b5a2-cf9f-4439-9b96-349d5d7b7b58 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66512024-12-20T22:22:06.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 82f5b5a2-cf9f-4439-9b96-349d5d7b7b58 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66522024-12-20T22:22:07.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f49d5041-987c-487e-a0a6-c93e811838f4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66532024-12-20T22:22:07.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f49d5041-987c-487e-a0a6-c93e811838f4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66542024-12-20T22:22:07.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f49d5041-987c-487e-a0a6-c93e811838f4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66552024-12-20T22:22:08.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f17faae8-6a2d-4aac-b13f-2ad0dab60575 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66562024-12-20T22:22:08.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f17faae8-6a2d-4aac-b13f-2ad0dab60575 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66572024-12-20T22:22:08.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f17faae8-6a2d-4aac-b13f-2ad0dab60575 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66582024-12-20T22:22:09.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4d38a18a-0267-4d42-a42b-c7c500c1c185 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66592024-12-20T22:22:09.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4d38a18a-0267-4d42-a42b-c7c500c1c185 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66602024-12-20T22:22:09.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4d38a18a-0267-4d42-a42b-c7c500c1c185 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66612024-12-20T22:22:10.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 236c1c70-d8cd-4ca7-845c-456f7e1df441 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
66622024-12-20T22:22:10.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 236c1c70-d8cd-4ca7-845c-456f7e1df441 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
66632024-12-20T22:22:10.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 236c1c70-d8cd-4ca7-845c-456f7e1df441 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
66642024-12-20T22:22:10.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = e7d7b73b-aef6-4704-a4c4-05b721f89bc3 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
66652024-12-20T22:22:10.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = e7d7b73b-aef6-4704-a4c4-05b721f89bc3 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
66662024-12-20T22:22:10.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = e7d7b73b-aef6-4704-a4c4-05b721f89bc3 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
66672024-12-20T22:22:10.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c675366-1c60-4c12-876f-0536cc39f0fc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66682024-12-20T22:22:10.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c675366-1c60-4c12-876f-0536cc39f0fc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66692024-12-20T22:22:10.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c675366-1c60-4c12-876f-0536cc39f0fc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66702024-12-20T22:22:11.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 53210a25-10a5-4333-95b4-cab9a6c7ea5a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66712024-12-20T22:22:11.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 53210a25-10a5-4333-95b4-cab9a6c7ea5a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66722024-12-20T22:22:11.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 53210a25-10a5-4333-95b4-cab9a6c7ea5a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66732024-12-20T22:22:12.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4eddbde7-30b5-48e4-981d-f3dbc1e93a08 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66742024-12-20T22:22:12.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4eddbde7-30b5-48e4-981d-f3dbc1e93a08 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66752024-12-20T22:22:12.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4eddbde7-30b5-48e4-981d-f3dbc1e93a08 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
66762024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
66772024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
66782024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66792024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
66802024-12-20T22:22:13.443ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66812024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
66822024-12-20T22:22:13.443ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
66832024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66842024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.53\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
66852024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
66862024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
66872024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66882024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
66892024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66902024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
66912024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
66922024-12-20T22:22:13.443ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:12:13.443129590 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66932024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66942024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
66952024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66962024-12-20T22:22:13.443ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
66972024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66982024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
66992024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67002024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
67012024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
67022024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
67032024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67042024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67052024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
67062024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67072024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67082024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
67092024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67102024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
67112024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
67122024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67132024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67142024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
67152024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
67162024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67172024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
67182024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
67192024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67202024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67212024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
67222024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67232024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
67242024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
67252024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67262024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
67272024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67282024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
67292024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
67302024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
67312024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67322024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
67332024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
67342024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67352024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
67362024-12-20T22:22:13.443ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67372024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
67382024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67392024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67402024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67412024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67422024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67432024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67442024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67452024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67462024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67472024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67482024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67492024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67502024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
67512024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67522024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67532024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67542024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67552024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67562024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67572024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67582024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67592024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67602024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67612024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67622024-12-20T22:22:13.444ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 371724281 } })
67632024-12-20T22:22:13.444ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 371788511 } })
67642024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
67652024-12-20T22:22:13.444ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.421335ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
67662024-12-20T22:22:13.445ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
67672024-12-20T22:22:13.445ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.828819ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
67682024-12-20T22:22:13.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67692024-12-20T22:22:13.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67702024-12-20T22:22:13.447ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67712024-12-20T22:22:13.447ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.858849ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67722024-12-20T22:22:13.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67732024-12-20T22:22:13.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67742024-12-20T22:22:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67752024-12-20T22:22:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67762024-12-20T22:22:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67772024-12-20T22:22:13.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67782024-12-20T22:22:13.451ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67792024-12-20T22:22:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67802024-12-20T22:22:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67812024-12-20T22:22:13.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67822024-12-20T22:22:13.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 383089225 } })
67832024-12-20T22:22:13.455ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67842024-12-20T22:22:13.456ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
67852024-12-20T22:22:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67862024-12-20T22:22:13.457ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:12:13.443129590 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
67872024-12-20T22:22:13.457ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.140733ms iteration = 9 status = {"expiration":"2024-12-20T22:12:13.443129590Z","pruned":[]}
67882024-12-20T22:22:13.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67892024-12-20T22:22:13.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67902024-12-20T22:22:13.458ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 385779212 } })
67912024-12-20T22:22:13.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67922024-12-20T22:22:13.458ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
67932024-12-20T22:22:13.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67942024-12-20T22:22:13.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67952024-12-20T22:22:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67962024-12-20T22:22:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67972024-12-20T22:22:13.460ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67982024-12-20T22:22:13.463ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67992024-12-20T22:22:13.463ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68002024-12-20T22:22:13.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68012024-12-20T22:22:13.464ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.462106ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
68022024-12-20T22:22:13.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68032024-12-20T22:22:13.466ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68042024-12-20T22:22:13.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68052024-12-20T22:22:13.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68062024-12-20T22:22:13.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68072024-12-20T22:22:13.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68082024-12-20T22:22:13.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68092024-12-20T22:22:13.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68102024-12-20T22:22:13.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68112024-12-20T22:22:13.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68122024-12-20T22:22:13.480ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 407979806 } })
68132024-12-20T22:22:13.481ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
68142024-12-20T22:22:13.490ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68152024-12-20T22:22:13.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68162024-12-20T22:22:13.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68172024-12-20T22:22:13.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68182024-12-20T22:22:13.500ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68192024-12-20T22:22:13.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68202024-12-20T22:22:13.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.705771ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
68212024-12-20T22:22:13.519ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68222024-12-20T22:22:13.519ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68232024-12-20T22:22:13.519ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68242024-12-20T22:22:13.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68252024-12-20T22:22:13.520ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68262024-12-20T22:22:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68272024-12-20T22:22:13.521ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68282024-12-20T22:22:13.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.217167ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
68292024-12-20T22:22:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68302024-12-20T22:22:13.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68312024-12-20T22:22:13.525ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68322024-12-20T22:22:13.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68332024-12-20T22:22:13.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68342024-12-20T22:22:13.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68352024-12-20T22:22:13.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68362024-12-20T22:22:13.529ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68372024-12-20T22:22:13.529ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
68382024-12-20T22:22:13.529ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.841524ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68392024-12-20T22:22:13.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68402024-12-20T22:22:13.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68412024-12-20T22:22:13.530ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
68422024-12-20T22:22:13.530ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
68432024-12-20T22:22:13.530ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 86.839954ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
68442024-12-20T22:22:13.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68452024-12-20T22:22:13.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68462024-12-20T22:22:13.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.42935ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68472024-12-20T22:22:13.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68482024-12-20T22:22:13.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68492024-12-20T22:22:13.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68502024-12-20T22:22:13.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68512024-12-20T22:22:13.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68522024-12-20T22:22:13.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
68532024-12-20T22:22:13.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68542024-12-20T22:22:13.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68552024-12-20T22:22:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.196738ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
68562024-12-20T22:22:13.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68572024-12-20T22:22:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68582024-12-20T22:22:13.548ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
68592024-12-20T22:22:13.548ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
68602024-12-20T22:22:13.548ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
68612024-12-20T22:22:13.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68622024-12-20T22:22:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68632024-12-20T22:22:13.552ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68642024-12-20T22:22:13.552ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68652024-12-20T22:22:13.552ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68662024-12-20T22:22:13.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68672024-12-20T22:22:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68682024-12-20T22:22:13.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68692024-12-20T22:22:13.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68702024-12-20T22:22:13.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68712024-12-20T22:22:13.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68722024-12-20T22:22:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68732024-12-20T22:22:13.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68742024-12-20T22:22:13.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68752024-12-20T22:22:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68762024-12-20T22:22:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
68772024-12-20T22:22:13.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68782024-12-20T22:22:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68792024-12-20T22:22:13.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68802024-12-20T22:22:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68812024-12-20T22:22:13.562ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.297371ms iteration = 17 status = 0
68822024-12-20T22:22:13.562ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68832024-12-20T22:22:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68842024-12-20T22:22:13.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68852024-12-20T22:22:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68862024-12-20T22:22:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68872024-12-20T22:22:13.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68882024-12-20T22:22:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68892024-12-20T22:22:13.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68902024-12-20T22:22:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68912024-12-20T22:22:13.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68922024-12-20T22:22:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68932024-12-20T22:22:13.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68942024-12-20T22:22:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68952024-12-20T22:22:13.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68962024-12-20T22:22:13.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68972024-12-20T22:22:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68982024-12-20T22:22:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68992024-12-20T22:22:13.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69002024-12-20T22:22:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69012024-12-20T22:22:13.569ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
69022024-12-20T22:22:13.569ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
69032024-12-20T22:22:13.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69042024-12-20T22:22:13.569ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
69052024-12-20T22:22:13.569ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 126.518033ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
69062024-12-20T22:22:13.569ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69072024-12-20T22:22:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69082024-12-20T22:22:13.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69092024-12-20T22:22:13.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69102024-12-20T22:22:13.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69112024-12-20T22:22:13.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69122024-12-20T22:22:13.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69132024-12-20T22:22:13.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 133.494103ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69142024-12-20T22:22:13.577ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
69152024-12-20T22:22:13.577ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
69162024-12-20T22:22:13.577ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
69172024-12-20T22:22:13.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 134.12078ms iteration = 10 status = {"generation":1}
69182024-12-20T22:22:13.581ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69192024-12-20T22:22:13.581ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
69202024-12-20T22:22:13.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69212024-12-20T22:22:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69222024-12-20T22:22:13.582ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
69232024-12-20T22:22:13.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 139.936468ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69242024-12-20T22:22:13.595ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
69252024-12-20T22:22:13.595ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69262024-12-20T22:22:13.596ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "219c05c6-ca8d-4257-8e61-e0791bc77e7a", "content-length": "26", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
69272024-12-20T22:22:13.596ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69282024-12-20T22:22:13.597ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69292024-12-20T22:22:13.614ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
69302024-12-20T22:22:13.614ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 171.142572ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
69312024-12-20T22:22:13.615ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
69322024-12-20T22:22:13.615ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69332024-12-20T22:22:13.615ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e6d889a-cd17-4ed4-b740-46a455763aed", "content-length": "26", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
69342024-12-20T22:22:13.615ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69352024-12-20T22:22:13.617ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
69362024-12-20T22:22:13.619ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
69372024-12-20T22:22:13.619ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 175.84289ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
69382024-12-20T22:22:13.624ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
69392024-12-20T22:22:13.624ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
69402024-12-20T22:22:13.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69412024-12-20T22:22:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69422024-12-20T22:22:13.625ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69432024-12-20T22:22:13.625ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
69442024-12-20T22:22:13.625ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 182.192223ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
69452024-12-20T22:22:13.626ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69462024-12-20T22:22:13.626ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 182.83328ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69472024-12-20T22:22:13.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69482024-12-20T22:22:13.627ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
69492024-12-20T22:22:13.627ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69502024-12-20T22:22:13.627ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86eeff40-54c8-4248-9666-013d31120d66", "content-length": "26", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
69512024-12-20T22:22:13.627ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69522024-12-20T22:22:13.628ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69532024-12-20T22:22:13.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69542024-12-20T22:22:13.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69552024-12-20T22:22:13.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69562024-12-20T22:22:13.632ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
69572024-12-20T22:22:13.632ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
69582024-12-20T22:22:13.632ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
69592024-12-20T22:22:13.632ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 188.895521ms iteration = 10 status = {"generation":2}
69602024-12-20T22:22:13.638ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
69612024-12-20T22:22:13.649ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69622024-12-20T22:22:13.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69632024-12-20T22:22:13.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69642024-12-20T22:22:13.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69652024-12-20T22:22:13.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69662024-12-20T22:22:13.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69672024-12-20T22:22:13.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69682024-12-20T22:22:13.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69692024-12-20T22:22:13.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69702024-12-20T22:22:13.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69712024-12-20T22:22:13.682ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 238.804124ms iteration = 20 status = {"physical_disks_added":0}
69722024-12-20T22:22:13.772ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 329.072572ms iteration = 17 status = {}
69732024-12-20T22:22:13.801ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69742024-12-20T22:22:13.801ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69752024-12-20T22:22:13.802ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a235893-6b2f-48d5-9906-a15909101168", "content-length": "372", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
69762024-12-20T22:22:13.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69772024-12-20T22:22:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69782024-12-20T22:22:13.812ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
69792024-12-20T22:22:13.812ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
69802024-12-20T22:22:13.812ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bee57d89-2ad6-4ee7-b814-f89f79bd2cc6", "content-length": "1", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
69812024-12-20T22:22:13.814ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69822024-12-20T22:22:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69832024-12-20T22:22:13.818ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 374.889393ms iteration = 17 status = null
69842024-12-20T22:22:13.855ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
69852024-12-20T22:22:13.855ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69862024-12-20T22:22:13.855ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1f0ed724-78ff-496b-9b7f-9aa0ee3a95b0", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
69872024-12-20T22:22:13.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69882024-12-20T22:22:13.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69892024-12-20T22:22:13.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69902024-12-20T22:22:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69912024-12-20T22:22:13.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69922024-12-20T22:22:13.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69932024-12-20T22:22:13.864ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
69942024-12-20T22:22:13.865ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "76abd5db-ea91-4412-91e5-f774516e1a48", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69952024-12-20T22:22:13.865ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69962024-12-20T22:22:13.866ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69972024-12-20T22:22:13.866ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69982024-12-20T22:22:13.866ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d60eb582-b1a2-488b-abd1-099ecd15d863", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69992024-12-20T22:22:13.866ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70002024-12-20T22:22:13.866ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9c0ba2c1-08b8-4a45-8d37-d890acd70451", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
70012024-12-20T22:22:13.869ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 426.370601ms iteration = 18 status = {}
70022024-12-20T22:22:13.869ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70032024-12-20T22:22:13.869ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 425.845726ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
70042024-12-20T22:22:13.911ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
70052024-12-20T22:22:13.911ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a5c2fa6b-7644-42f9-9a74-e91ce2d66614", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70062024-12-20T22:22:13.911ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70072024-12-20T22:22:13.913ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "10454d34-42a5-4cff-85a7-a702ef6497fb", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70082024-12-20T22:22:13.913ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70092024-12-20T22:22:13.915ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "92795c09-63ef-4fcd-a314-3ed3fa15d91a", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70102024-12-20T22:22:13.915ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70112024-12-20T22:22:13.917ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
70122024-12-20T22:22:13.917ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 474.261223ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
70132024-12-20T22:22:13.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3d8cf34f-a88b-4a4d-91ff-a056eab2d270 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70142024-12-20T22:22:13.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3d8cf34f-a88b-4a4d-91ff-a056eab2d270 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70152024-12-20T22:22:13.951ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70162024-12-20T22:22:13.951ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e05249d-9018-4ee2-a52b-b9726b261b9f", "content-length": "691", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
70172024-12-20T22:22:13.951ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
70182024-12-20T22:22:13.951ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
70192024-12-20T22:22:13.951ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
70202024-12-20T22:22:13.952ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 509.776281ms iteration = 17 status = {}
70212024-12-20T22:22:13.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3d8cf34f-a88b-4a4d-91ff-a056eab2d270 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70222024-12-20T22:22:13.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70232024-12-20T22:22:13.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70242024-12-20T22:22:13.982ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
70252024-12-20T22:22:13.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70262024-12-20T22:22:13.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70272024-12-20T22:22:13.992ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
70282024-12-20T22:22:13.992ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "de18d36a-dd8c-4807-a630-9f9f820ec773", "content-length": "134", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
70292024-12-20T22:22:13.992ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
70302024-12-20T22:22:13.992ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
70312024-12-20T22:22:13.993ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
70322024-12-20T22:22:13.993ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70332024-12-20T22:22:13.993ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70342024-12-20T22:22:13.993ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70352024-12-20T22:22:13.993ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70362024-12-20T22:22:13.993ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70372024-12-20T22:22:13.993ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70382024-12-20T22:22:13.993ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70392024-12-20T22:22:13.993ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
70402024-12-20T22:22:13.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70412024-12-20T22:22:13.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70422024-12-20T22:22:13.995ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
70432024-12-20T22:22:13.995ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1073b808-4ff8-414b-bbe2-0d33b311b31b", "content-length": "2", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
70442024-12-20T22:22:13.995ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
70452024-12-20T22:22:13.996ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d11f6dc-ccc2-4e4f-9281-ac1f5beb74b4", "content-length": "52", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
70462024-12-20T22:22:13.996ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
70472024-12-20T22:22:13.996ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70482024-12-20T22:22:14.091ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "385adce9-0d89-40d0-b1ff-b5387b993616", "date": "Fri, 20 Dec 2024 22:22:13 GMT"} })
70492024-12-20T22:22:14.091ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
70502024-12-20T22:22:14.091ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70512024-12-20T22:22:14.092ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "28d9d72a-d066-49f9-aade-8d574feb9c57", "content-length": "682", "date": "Fri, 20 Dec 2024 22:22:14 GMT"} })
70522024-12-20T22:22:14.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70532024-12-20T22:22:14.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70542024-12-20T22:22:14.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70552024-12-20T22:22:14.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70562024-12-20T22:22:14.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70572024-12-20T22:22:14.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70582024-12-20T22:22:14.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70592024-12-20T22:22:14.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70602024-12-20T22:22:14.111ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 667.965083ms iteration = 17 status = {}
70612024-12-20T22:22:14.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f7228100-d973-4ad7-b2c0-dc469ff9a309 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
70622024-12-20T22:22:14.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f7228100-d973-4ad7-b2c0-dc469ff9a309 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
70632024-12-20T22:22:14.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f7228100-d973-4ad7-b2c0-dc469ff9a309 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
70642024-12-20T22:22:14.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 47e12a95-2482-4665-9554-17db463fc430 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70652024-12-20T22:22:14.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 47e12a95-2482-4665-9554-17db463fc430 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70662024-12-20T22:22:14.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 47e12a95-2482-4665-9554-17db463fc430 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70672024-12-20T22:22:15.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1266 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 42a36454-f465-4863-9e49-8118735f3496 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
70682024-12-20T22:22:15.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = efe074ed-ae59-4a29-88f7-7f3b0e132d0d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70692024-12-20T22:22:15.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = efe074ed-ae59-4a29-88f7-7f3b0e132d0d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70702024-12-20T22:22:15.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = efe074ed-ae59-4a29-88f7-7f3b0e132d0d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70712024-12-20T22:22:17.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7cb2d572-2f47-48f6-88ce-61a10a0725c7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70722024-12-20T22:22:17.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7cb2d572-2f47-48f6-88ce-61a10a0725c7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70732024-12-20T22:22:17.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7cb2d572-2f47-48f6-88ce-61a10a0725c7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70742024-12-20T22:22:18.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ad69e575-1ada-45ab-b9a5-6e755374a4a9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70752024-12-20T22:22:18.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ad69e575-1ada-45ab-b9a5-6e755374a4a9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70762024-12-20T22:22:18.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ad69e575-1ada-45ab-b9a5-6e755374a4a9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70772024-12-20T22:22:19.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e60375dc-2ff3-4c44-9bc1-7676529349c7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70782024-12-20T22:22:19.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e60375dc-2ff3-4c44-9bc1-7676529349c7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70792024-12-20T22:22:19.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e60375dc-2ff3-4c44-9bc1-7676529349c7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70802024-12-20T22:22:19.370ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
70812024-12-20T22:22:19.370ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
70822024-12-20T22:22:19.401ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
70832024-12-20T22:22:19.401ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:50741
70842024-12-20T22:22:19.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50741 req_id = d6ab83fb-9ef8-4d69-9e1c-5cfe11f5c352 roles = RoleSet { roles: {} } uri = /metrics/producers
70852024-12-20T22:22:19.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50741 req_id = d6ab83fb-9ef8-4d69-9e1c-5cfe11f5c352 resource = Database result = Ok(()) uri = /metrics/producers
70862024-12-20T22:22:19.439ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
70872024-12-20T22:22:19.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37871 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50741 req_id = d6ab83fb-9ef8-4d69-9e1c-5cfe11f5c352 response_code = 201 uri = /metrics/producers
70882024-12-20T22:22:19.439ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d6ab83fb-9ef8-4d69-9e1c-5cfe11f5c352", "content-length": "41", "date": "Fri, 20 Dec 2024 22:22:19 GMT"} })
70892024-12-20T22:22:19.441ZDEBGnexus (producer-registration-task): registered with nexus successfully
70902024-12-20T22:22:19.441ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
70912024-12-20T22:22:20.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9cf99294-dc69-4651-9c49-e3da15f3ece2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70922024-12-20T22:22:20.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9cf99294-dc69-4651-9c49-e3da15f3ece2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70932024-12-20T22:22:20.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9cf99294-dc69-4651-9c49-e3da15f3ece2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70942024-12-20T22:22:21.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 82298fa0-e1b1-4888-8995-475326391060 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70952024-12-20T22:22:21.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 82298fa0-e1b1-4888-8995-475326391060 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70962024-12-20T22:22:21.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 82298fa0-e1b1-4888-8995-475326391060 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70972024-12-20T22:22:22.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f92e763b-d582-4ddb-b2b9-df3b9ceb71b8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70982024-12-20T22:22:22.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f92e763b-d582-4ddb-b2b9-df3b9ceb71b8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
70992024-12-20T22:22:22.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f92e763b-d582-4ddb-b2b9-df3b9ceb71b8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71002024-12-20T22:22:23.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5987c90b-243e-4787-8f40-c8a24c923e33 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71012024-12-20T22:22:23.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5987c90b-243e-4787-8f40-c8a24c923e33 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71022024-12-20T22:22:23.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5987c90b-243e-4787-8f40-c8a24c923e33 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71032024-12-20T22:22:23.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
71042024-12-20T22:22:23.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
71052024-12-20T22:22:23.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71062024-12-20T22:22:23.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71072024-12-20T22:22:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71082024-12-20T22:22:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71092024-12-20T22:22:23.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71102024-12-20T22:22:23.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71112024-12-20T22:22:23.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.331666ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71122024-12-20T22:22:23.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71132024-12-20T22:22:23.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71142024-12-20T22:22:23.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71152024-12-20T22:22:23.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71162024-12-20T22:22:23.481ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71172024-12-20T22:22:23.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71182024-12-20T22:22:23.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71192024-12-20T22:22:23.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
71202024-12-20T22:22:23.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71212024-12-20T22:22:23.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71222024-12-20T22:22:23.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
71232024-12-20T22:22:23.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.235308ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
71242024-12-20T22:22:24.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c167f37d-f758-40e2-a945-89ef25b06683 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71252024-12-20T22:22:24.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c167f37d-f758-40e2-a945-89ef25b06683 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71262024-12-20T22:22:24.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c167f37d-f758-40e2-a945-89ef25b06683 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71272024-12-20T22:22:25.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6df350ff-0cce-4f09-98ba-09711c7fe5c5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71282024-12-20T22:22:25.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6df350ff-0cce-4f09-98ba-09711c7fe5c5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71292024-12-20T22:22:25.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6df350ff-0cce-4f09-98ba-09711c7fe5c5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71302024-12-20T22:22:25.689ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1450 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 668e1db5-c6b9-48a2-82b6-6f83359acd4b response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
71312024-12-20T22:22:26.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6fe2fcff-1fe5-4344-9504-980363b3d337 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71322024-12-20T22:22:26.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6fe2fcff-1fe5-4344-9504-980363b3d337 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71332024-12-20T22:22:26.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6fe2fcff-1fe5-4344-9504-980363b3d337 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71342024-12-20T22:22:27.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 563108a7-8657-44d2-9ffc-b82bcf11fa33 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71352024-12-20T22:22:27.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 563108a7-8657-44d2-9ffc-b82bcf11fa33 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71362024-12-20T22:22:27.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 563108a7-8657-44d2-9ffc-b82bcf11fa33 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71372024-12-20T22:22:28.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4d4dd75d-082e-4a49-b51b-487b9003f127 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71382024-12-20T22:22:28.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4d4dd75d-082e-4a49-b51b-487b9003f127 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71392024-12-20T22:22:28.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4d4dd75d-082e-4a49-b51b-487b9003f127 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71402024-12-20T22:22:29.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 30e09778-1a24-480d-bfe1-814d6aebd0ab roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71412024-12-20T22:22:29.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 30e09778-1a24-480d-bfe1-814d6aebd0ab resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71422024-12-20T22:22:29.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 30e09778-1a24-480d-bfe1-814d6aebd0ab response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71432024-12-20T22:22:30.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 168f4919-39dc-4fd3-9851-6e9a2ad76f03 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71442024-12-20T22:22:30.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 168f4919-39dc-4fd3-9851-6e9a2ad76f03 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71452024-12-20T22:22:30.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 168f4919-39dc-4fd3-9851-6e9a2ad76f03 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71462024-12-20T22:22:31.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b31dbce3-711c-477a-9005-2a902a4632ad roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71472024-12-20T22:22:31.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b31dbce3-711c-477a-9005-2a902a4632ad resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71482024-12-20T22:22:31.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b31dbce3-711c-477a-9005-2a902a4632ad response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71492024-12-20T22:22:32.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9ab8b34d-6a3d-4bc9-b665-16644de50ed1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71502024-12-20T22:22:32.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9ab8b34d-6a3d-4bc9-b665-16644de50ed1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71512024-12-20T22:22:32.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9ab8b34d-6a3d-4bc9-b665-16644de50ed1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71522024-12-20T22:22:33.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9427bc8f-d6b6-49dd-acd6-ea5cde373657 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71532024-12-20T22:22:33.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9427bc8f-d6b6-49dd-acd6-ea5cde373657 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71542024-12-20T22:22:33.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9427bc8f-d6b6-49dd-acd6-ea5cde373657 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71552024-12-20T22:22:33.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
71562024-12-20T22:22:33.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
71572024-12-20T22:22:33.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71582024-12-20T22:22:33.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71592024-12-20T22:22:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71602024-12-20T22:22:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71612024-12-20T22:22:33.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71622024-12-20T22:22:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71632024-12-20T22:22:33.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71642024-12-20T22:22:33.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71652024-12-20T22:22:33.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71662024-12-20T22:22:33.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71672024-12-20T22:22:33.478ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.576238ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71682024-12-20T22:22:33.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71692024-12-20T22:22:33.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71702024-12-20T22:22:33.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71712024-12-20T22:22:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
71722024-12-20T22:22:33.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71732024-12-20T22:22:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71742024-12-20T22:22:33.526ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
71752024-12-20T22:22:33.526ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.017735ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
71762024-12-20T22:22:34.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5dba594f-57dc-40ac-916c-837f9987f03a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71772024-12-20T22:22:34.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5dba594f-57dc-40ac-916c-837f9987f03a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71782024-12-20T22:22:34.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5dba594f-57dc-40ac-916c-837f9987f03a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71792024-12-20T22:22:35.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 67387c8b-3531-418b-b2ef-fdc8be19177f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71802024-12-20T22:22:35.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 67387c8b-3531-418b-b2ef-fdc8be19177f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71812024-12-20T22:22:35.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 67387c8b-3531-418b-b2ef-fdc8be19177f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71822024-12-20T22:22:35.689ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1321 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 65528dfa-7e13-4daa-b0ab-e2823bf45b71 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
71832024-12-20T22:22:36.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7ff9c732-d744-4c17-a294-2d90b240ef52 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71842024-12-20T22:22:36.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7ff9c732-d744-4c17-a294-2d90b240ef52 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71852024-12-20T22:22:36.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7ff9c732-d744-4c17-a294-2d90b240ef52 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71862024-12-20T22:22:37.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dae89b21-4175-4290-84e3-194e0e09d1bb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71872024-12-20T22:22:37.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dae89b21-4175-4290-84e3-194e0e09d1bb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71882024-12-20T22:22:37.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dae89b21-4175-4290-84e3-194e0e09d1bb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71892024-12-20T22:22:38.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2320cc0-cfc2-4535-9b71-82e308ae034e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71902024-12-20T22:22:38.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2320cc0-cfc2-4535-9b71-82e308ae034e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71912024-12-20T22:22:38.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2320cc0-cfc2-4535-9b71-82e308ae034e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71922024-12-20T22:22:39.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 036fbccd-99ca-4cb7-8e10-7dd272b95f9b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71932024-12-20T22:22:39.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 036fbccd-99ca-4cb7-8e10-7dd272b95f9b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71942024-12-20T22:22:39.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 036fbccd-99ca-4cb7-8e10-7dd272b95f9b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71952024-12-20T22:22:40.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8fe3aefe-83f3-44b1-bb41-3c44e85cfb23 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71962024-12-20T22:22:40.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8fe3aefe-83f3-44b1-bb41-3c44e85cfb23 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71972024-12-20T22:22:40.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8fe3aefe-83f3-44b1-bb41-3c44e85cfb23 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71982024-12-20T22:22:41.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 98fdccc6-b415-4773-a258-c95a82647a5d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
71992024-12-20T22:22:41.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 98fdccc6-b415-4773-a258-c95a82647a5d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
72002024-12-20T22:22:41.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 98fdccc6-b415-4773-a258-c95a82647a5d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
72012024-12-20T22:22:42.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6646b6a5-d180-4e19-831a-70f49528e5b4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
72022024-12-20T22:22:42.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6646b6a5-d180-4e19-831a-70f49528e5b4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
72032024-12-20T22:22:42.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6646b6a5-d180-4e19-831a-70f49528e5b4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
72042024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
72052024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72062024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72072024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
72082024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72092024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
72102024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72112024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
72122024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
72132024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72142024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
72152024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
72162024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72172024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
72182024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
72192024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
72202024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
72212024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72222024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
72232024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
72242024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
72252024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72262024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72272024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
72282024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72292024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72302024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
72312024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
72322024-12-20T22:22:43.443ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
72332024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72342024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72352024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
72362024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72372024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
72382024-12-20T22:22:43.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72392024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72402024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72412024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72422024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72432024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72442024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72452024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72462024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72472024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72482024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
72492024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72502024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72512024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72522024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72532024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72542024-12-20T22:22:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72552024-12-20T22:22:43.447ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.168542ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72562024-12-20T22:22:43.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 377478959 } })
72572024-12-20T22:22:43.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 377586650 } })
72582024-12-20T22:22:43.450ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72592024-12-20T22:22:43.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
72602024-12-20T22:22:43.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
72612024-12-20T22:22:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72622024-12-20T22:22:43.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72632024-12-20T22:22:43.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72642024-12-20T22:22:43.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72652024-12-20T22:22:43.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72662024-12-20T22:22:43.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72672024-12-20T22:22:43.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72682024-12-20T22:22:43.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72692024-12-20T22:22:43.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72702024-12-20T22:22:43.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72712024-12-20T22:22:43.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72722024-12-20T22:22:43.460ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 387765882 } })
72732024-12-20T22:22:43.461ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
72742024-12-20T22:22:43.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72752024-12-20T22:22:43.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72762024-12-20T22:22:43.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72772024-12-20T22:22:43.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.984253ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
72782024-12-20T22:22:43.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.350237ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
72792024-12-20T22:22:43.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72802024-12-20T22:22:43.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72812024-12-20T22:22:43.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72822024-12-20T22:22:43.496ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72832024-12-20T22:22:43.497ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72842024-12-20T22:22:43.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72852024-12-20T22:22:43.498ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72862024-12-20T22:22:43.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72872024-12-20T22:22:43.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72882024-12-20T22:22:43.500ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72892024-12-20T22:22:43.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72902024-12-20T22:22:43.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72912024-12-20T22:22:43.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72922024-12-20T22:22:43.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72932024-12-20T22:22:43.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72942024-12-20T22:22:43.502ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72952024-12-20T22:22:43.502ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72962024-12-20T22:22:43.502ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72972024-12-20T22:22:43.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72982024-12-20T22:22:43.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72992024-12-20T22:22:43.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73002024-12-20T22:22:43.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73012024-12-20T22:22:43.509ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.201896ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73022024-12-20T22:22:43.510ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73032024-12-20T22:22:43.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73042024-12-20T22:22:43.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73052024-12-20T22:22:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73062024-12-20T22:22:43.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73072024-12-20T22:22:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73082024-12-20T22:22:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73092024-12-20T22:22:43.513ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73102024-12-20T22:22:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73112024-12-20T22:22:43.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73122024-12-20T22:22:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73132024-12-20T22:22:43.518ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73142024-12-20T22:22:43.518ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73152024-12-20T22:22:43.518ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73162024-12-20T22:22:43.518ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f7501b5-cf14-4516-bfd2-b89c71649bfb", "content-length": "26", "date": "Fri, 20 Dec 2024 22:22:43 GMT"} })
73172024-12-20T22:22:43.518ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73182024-12-20T22:22:43.520ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73192024-12-20T22:22:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73202024-12-20T22:22:43.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73212024-12-20T22:22:43.521ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73222024-12-20T22:22:43.521ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73232024-12-20T22:22:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73242024-12-20T22:22:43.521ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "32f217d0-d04d-4857-86e9-8a732ad3a922", "content-length": "26", "date": "Fri, 20 Dec 2024 22:22:43 GMT"} })
73252024-12-20T22:22:43.521ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73262024-12-20T22:22:43.523ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73272024-12-20T22:22:43.530ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
73282024-12-20T22:22:43.530ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73292024-12-20T22:22:43.530ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf4a40f3-f5fd-476f-8803-e5752c42ae53", "content-length": "26", "date": "Fri, 20 Dec 2024 22:22:43 GMT"} })
73302024-12-20T22:22:43.530ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73312024-12-20T22:22:43.533ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
73322024-12-20T22:22:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.011637ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73332024-12-20T22:22:43.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.32935ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
73342024-12-20T22:22:43.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73352024-12-20T22:22:43.552ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73362024-12-20T22:22:43.553ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73372024-12-20T22:22:43.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73382024-12-20T22:22:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73392024-12-20T22:22:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
73402024-12-20T22:22:43.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73412024-12-20T22:22:43.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73422024-12-20T22:22:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73432024-12-20T22:22:43.556ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.650144ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73442024-12-20T22:22:43.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73452024-12-20T22:22:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
73462024-12-20T22:22:43.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73472024-12-20T22:22:43.559ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73482024-12-20T22:22:43.559ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.721425ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73492024-12-20T22:22:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73502024-12-20T22:22:43.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73512024-12-20T22:22:43.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73522024-12-20T22:22:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73532024-12-20T22:22:43.560ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.23717ms iteration = 18 status = 0
73542024-12-20T22:22:43.568ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
73552024-12-20T22:22:43.568ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 124.473933ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
73562024-12-20T22:22:43.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 583a551a-7b74-4cb6-a0c8-d25ac4bc30c5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
73572024-12-20T22:22:43.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 583a551a-7b74-4cb6-a0c8-d25ac4bc30c5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
73582024-12-20T22:22:43.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 583a551a-7b74-4cb6-a0c8-d25ac4bc30c5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
73592024-12-20T22:22:43.587ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73602024-12-20T22:22:43.587ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73612024-12-20T22:22:43.587ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.664866ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73622024-12-20T22:22:43.596ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73632024-12-20T22:22:43.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73642024-12-20T22:22:43.603ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 159.99825ms iteration = 18 status = {}
73652024-12-20T22:22:43.609ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73662024-12-20T22:22:43.609ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "45e1d464-a73d-4490-9393-ba96e8a03e00", "content-length": "1", "date": "Fri, 20 Dec 2024 22:22:42 GMT"} })
73672024-12-20T22:22:43.611ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73682024-12-20T22:22:43.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73692024-12-20T22:22:43.613ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 169.89313ms iteration = 18 status = null
73702024-12-20T22:22:43.639ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 195.497007ms iteration = 21 status = {"physical_disks_added":0}
73712024-12-20T22:22:43.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73722024-12-20T22:22:43.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73732024-12-20T22:22:43.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73742024-12-20T22:22:43.667ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73752024-12-20T22:22:43.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73762024-12-20T22:22:43.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73772024-12-20T22:22:43.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73782024-12-20T22:22:43.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73792024-12-20T22:22:43.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73802024-12-20T22:22:43.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73812024-12-20T22:22:43.699ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73822024-12-20T22:22:43.699ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73832024-12-20T22:22:43.699ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "90799c93-1727-4854-8026-3d2bd3ff4320", "content-length": "372", "date": "Fri, 20 Dec 2024 22:22:43 GMT"} })
73842024-12-20T22:22:43.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73852024-12-20T22:22:43.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73862024-12-20T22:22:43.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73872024-12-20T22:22:43.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73882024-12-20T22:22:43.712ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
73892024-12-20T22:22:43.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73902024-12-20T22:22:43.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73912024-12-20T22:22:43.721ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73922024-12-20T22:22:43.721ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ebcda41-1c01-4301-a81e-a0f495b24b00", "content-length": "134", "date": "Fri, 20 Dec 2024 22:22:42 GMT"} })
73932024-12-20T22:22:43.721ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73942024-12-20T22:22:43.721ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
73952024-12-20T22:22:43.722ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73962024-12-20T22:22:43.722ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73972024-12-20T22:22:43.722ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73982024-12-20T22:22:43.722ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73992024-12-20T22:22:43.722ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74002024-12-20T22:22:43.722ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74012024-12-20T22:22:43.722ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74022024-12-20T22:22:43.722ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74032024-12-20T22:22:43.722ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
74042024-12-20T22:22:43.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74052024-12-20T22:22:43.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74062024-12-20T22:22:43.724ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74072024-12-20T22:22:43.724ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cf5e5cf-40ab-465c-a8f6-1c6ad0d22bb0", "content-length": "2", "date": "Fri, 20 Dec 2024 22:22:42 GMT"} })
74082024-12-20T22:22:43.724ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74092024-12-20T22:22:43.724ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fb56c2c-3c47-448e-b120-c0e668814992", "content-length": "52", "date": "Fri, 20 Dec 2024 22:22:42 GMT"} })
74102024-12-20T22:22:43.724ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
74112024-12-20T22:22:43.724ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74122024-12-20T22:22:43.745ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
74132024-12-20T22:22:43.745ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74142024-12-20T22:22:43.818ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74152024-12-20T22:22:43.852ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "00959822-35e9-4e21-839c-99909053364c", "date": "Fri, 20 Dec 2024 22:22:43 GMT"} })
74162024-12-20T22:22:43.852ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
74172024-12-20T22:22:43.852ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74182024-12-20T22:22:43.852ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "75771192-c5f4-427c-aedb-0019c710c5a0", "date": "Fri, 20 Dec 2024 22:22:43 GMT"} })
74192024-12-20T22:22:43.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74202024-12-20T22:22:43.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74212024-12-20T22:22:43.853ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8793187e-b0c3-45c1-97d0-5f47623cf3b5", "content-length": "691", "date": "Fri, 20 Dec 2024 22:22:43 GMT"} })
74222024-12-20T22:22:43.853ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
74232024-12-20T22:22:43.853ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
74242024-12-20T22:22:43.853ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
74252024-12-20T22:22:43.853ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbcbcc73-adce-4a41-9575-c586d41472a6", "content-length": "682", "date": "Fri, 20 Dec 2024 22:22:43 GMT"} })
74262024-12-20T22:22:43.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74272024-12-20T22:22:43.855ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 411.679093ms iteration = 18 status = {}
74282024-12-20T22:22:43.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74292024-12-20T22:22:43.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74302024-12-20T22:22:43.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74312024-12-20T22:22:43.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74322024-12-20T22:22:43.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74332024-12-20T22:22:43.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74342024-12-20T22:22:43.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74352024-12-20T22:22:43.866ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74362024-12-20T22:22:43.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74372024-12-20T22:22:43.866ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74382024-12-20T22:22:43.866ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e25cc472-0b06-4bca-bb49-cda8a7288468", "date": "Fri, 20 Dec 2024 22:22:43 GMT"} })
74392024-12-20T22:22:43.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74402024-12-20T22:22:43.867ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 424.24241ms iteration = 19 status = {}
74412024-12-20T22:22:43.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74422024-12-20T22:22:43.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74432024-12-20T22:22:43.875ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 432.1866ms iteration = 18 status = {}
74442024-12-20T22:22:44.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c32005b-dc61-4cf2-bc37-16bb6ab353f1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74452024-12-20T22:22:44.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c32005b-dc61-4cf2-bc37-16bb6ab353f1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74462024-12-20T22:22:44.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c32005b-dc61-4cf2-bc37-16bb6ab353f1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74472024-12-20T22:22:44.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 2488d54d-9beb-46cc-98da-0881078a5e4a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
74482024-12-20T22:22:44.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 2488d54d-9beb-46cc-98da-0881078a5e4a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
74492024-12-20T22:22:44.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 2488d54d-9beb-46cc-98da-0881078a5e4a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
74502024-12-20T22:22:45.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 48d43454-1a41-4db5-8b95-593a770ce507 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74512024-12-20T22:22:45.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 48d43454-1a41-4db5-8b95-593a770ce507 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74522024-12-20T22:22:45.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 48d43454-1a41-4db5-8b95-593a770ce507 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74532024-12-20T22:22:45.688ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1317 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 57613f7d-2938-404a-9c81-21adf14f05c0 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
74542024-12-20T22:22:46.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d3db34b-39bd-4eb3-bf35-af33e0143424 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74552024-12-20T22:22:46.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d3db34b-39bd-4eb3-bf35-af33e0143424 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74562024-12-20T22:22:46.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d3db34b-39bd-4eb3-bf35-af33e0143424 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74572024-12-20T22:22:47.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f78681d4-ea22-4ae0-93b8-554f4134d5fb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74582024-12-20T22:22:47.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f78681d4-ea22-4ae0-93b8-554f4134d5fb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74592024-12-20T22:22:47.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f78681d4-ea22-4ae0-93b8-554f4134d5fb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74602024-12-20T22:22:48.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca51c988-473b-401b-a2af-b4379cee206f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74612024-12-20T22:22:48.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca51c988-473b-401b-a2af-b4379cee206f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74622024-12-20T22:22:48.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ca51c988-473b-401b-a2af-b4379cee206f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74632024-12-20T22:22:49.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 932a46f5-994c-4a95-b239-eb621392c914 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74642024-12-20T22:22:49.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 932a46f5-994c-4a95-b239-eb621392c914 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74652024-12-20T22:22:49.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 932a46f5-994c-4a95-b239-eb621392c914 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74662024-12-20T22:22:50.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e317b5de-67f8-4ccb-be2e-ac632ece014e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74672024-12-20T22:22:50.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e317b5de-67f8-4ccb-be2e-ac632ece014e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74682024-12-20T22:22:50.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e317b5de-67f8-4ccb-be2e-ac632ece014e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74692024-12-20T22:22:51.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8098622-8d18-42b5-b4c1-b37c8a1db648 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74702024-12-20T22:22:51.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8098622-8d18-42b5-b4c1-b37c8a1db648 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74712024-12-20T22:22:51.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8098622-8d18-42b5-b4c1-b37c8a1db648 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74722024-12-20T22:22:52.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 694c60f5-f68a-4178-b0cd-bd5bc2ff56ad roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74732024-12-20T22:22:52.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 694c60f5-f68a-4178-b0cd-bd5bc2ff56ad resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74742024-12-20T22:22:52.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 694c60f5-f68a-4178-b0cd-bd5bc2ff56ad response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74752024-12-20T22:22:53.443ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
74762024-12-20T22:22:53.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
74772024-12-20T22:22:53.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74782024-12-20T22:22:53.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74792024-12-20T22:22:53.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74802024-12-20T22:22:53.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74812024-12-20T22:22:53.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74822024-12-20T22:22:53.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74832024-12-20T22:22:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74842024-12-20T22:22:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74852024-12-20T22:22:53.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74862024-12-20T22:22:53.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74872024-12-20T22:22:53.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74882024-12-20T22:22:53.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74892024-12-20T22:22:53.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74902024-12-20T22:22:53.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
74912024-12-20T22:22:53.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74922024-12-20T22:22:53.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74932024-12-20T22:22:53.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
74942024-12-20T22:22:53.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.460766ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
74952024-12-20T22:22:53.475ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.143974ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74962024-12-20T22:22:53.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0b31a546-0210-4cb8-8d4e-a8c7fdf43b51 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74972024-12-20T22:22:53.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0b31a546-0210-4cb8-8d4e-a8c7fdf43b51 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74982024-12-20T22:22:53.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0b31a546-0210-4cb8-8d4e-a8c7fdf43b51 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
74992024-12-20T22:22:54.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5e8dd715-fe72-4538-a9ff-638f3a9414d4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75002024-12-20T22:22:54.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5e8dd715-fe72-4538-a9ff-638f3a9414d4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75012024-12-20T22:22:54.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5e8dd715-fe72-4538-a9ff-638f3a9414d4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75022024-12-20T22:22:55.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 3f79249f-beb9-4ecc-b85b-28213687d247 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
75032024-12-20T22:22:55.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 3f79249f-beb9-4ecc-b85b-28213687d247 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
75042024-12-20T22:22:55.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 3f79249f-beb9-4ecc-b85b-28213687d247 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
75052024-12-20T22:22:55.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b7725dd4-6955-4fe0-a8e4-b10b9894592f roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
75062024-12-20T22:22:55.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b7725dd4-6955-4fe0-a8e4-b10b9894592f resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
75072024-12-20T22:22:55.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b7725dd4-6955-4fe0-a8e4-b10b9894592f response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
75082024-12-20T22:22:55.689ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 9fa32e60-02e9-47de-98c3-79ff3396eade response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
75092024-12-20T22:22:55.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 321cc723-17e6-44e9-b158-06a95957837f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75102024-12-20T22:22:55.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 321cc723-17e6-44e9-b158-06a95957837f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75112024-12-20T22:22:55.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 321cc723-17e6-44e9-b158-06a95957837f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75122024-12-20T22:22:56.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c11e14a-26b2-418d-a1b5-dd927cebac70 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75132024-12-20T22:22:56.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c11e14a-26b2-418d-a1b5-dd927cebac70 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75142024-12-20T22:22:56.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c11e14a-26b2-418d-a1b5-dd927cebac70 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75152024-12-20T22:22:57.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8a563e04-440b-4160-976f-7137f6a7efeb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75162024-12-20T22:22:57.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8a563e04-440b-4160-976f-7137f6a7efeb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75172024-12-20T22:22:57.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8a563e04-440b-4160-976f-7137f6a7efeb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75182024-12-20T22:22:58.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15577870-969b-4b58-8bc9-b9b3dfe87062 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75192024-12-20T22:22:58.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15577870-969b-4b58-8bc9-b9b3dfe87062 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75202024-12-20T22:22:58.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15577870-969b-4b58-8bc9-b9b3dfe87062 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75212024-12-20T22:22:59.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7c568d5a-0ab2-413b-9063-c71a33b9955c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75222024-12-20T22:22:59.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7c568d5a-0ab2-413b-9063-c71a33b9955c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75232024-12-20T22:22:59.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7c568d5a-0ab2-413b-9063-c71a33b9955c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75242024-12-20T22:23:00.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 89682e43-b5ee-4847-802f-b90b9f72a365 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75252024-12-20T22:23:00.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 89682e43-b5ee-4847-802f-b90b9f72a365 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75262024-12-20T22:23:00.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 89682e43-b5ee-4847-802f-b90b9f72a365 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75272024-12-20T22:23:01.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 438ea207-5bcc-4973-871a-378a6f5c4e5b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75282024-12-20T22:23:01.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 438ea207-5bcc-4973-871a-378a6f5c4e5b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75292024-12-20T22:23:01.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 438ea207-5bcc-4973-871a-378a6f5c4e5b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75302024-12-20T22:23:02.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a00223e8-70b3-4787-a516-b542c868b155 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75312024-12-20T22:23:02.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a00223e8-70b3-4787-a516-b542c868b155 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75322024-12-20T22:23:02.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a00223e8-70b3-4787-a516-b542c868b155 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75332024-12-20T22:23:03.442ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
75342024-12-20T22:23:03.442ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
75352024-12-20T22:23:03.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75362024-12-20T22:23:03.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75372024-12-20T22:23:03.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75382024-12-20T22:23:03.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75392024-12-20T22:23:03.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75402024-12-20T22:23:03.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75412024-12-20T22:23:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75422024-12-20T22:23:03.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.305524ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75432024-12-20T22:23:03.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75442024-12-20T22:23:03.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75452024-12-20T22:23:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75462024-12-20T22:23:03.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75472024-12-20T22:23:03.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75482024-12-20T22:23:03.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75492024-12-20T22:23:03.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
75502024-12-20T22:23:03.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75512024-12-20T22:23:03.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75522024-12-20T22:23:03.462ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
75532024-12-20T22:23:03.462ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.91723ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
75542024-12-20T22:23:04.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81bd937a-d879-4012-ae05-f4823f79a9e8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75552024-12-20T22:23:04.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81bd937a-d879-4012-ae05-f4823f79a9e8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75562024-12-20T22:23:04.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81bd937a-d879-4012-ae05-f4823f79a9e8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75572024-12-20T22:23:05.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 221233f3-3d11-44eb-b9e0-82d67181c159 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75582024-12-20T22:23:05.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 221233f3-3d11-44eb-b9e0-82d67181c159 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75592024-12-20T22:23:05.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 221233f3-3d11-44eb-b9e0-82d67181c159 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75602024-12-20T22:23:05.689ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1432 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 21e7e5e3-902d-4eda-b222-cab04e60347f response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
75612024-12-20T22:23:06.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 994faf74-7d53-4bc2-be1c-1072e3ad2e9a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75622024-12-20T22:23:06.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 994faf74-7d53-4bc2-be1c-1072e3ad2e9a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75632024-12-20T22:23:06.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 994faf74-7d53-4bc2-be1c-1072e3ad2e9a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75642024-12-20T22:23:07.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9d1f4c93-aa49-453e-8b97-73cb8028bbba roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75652024-12-20T22:23:07.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9d1f4c93-aa49-453e-8b97-73cb8028bbba resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75662024-12-20T22:23:07.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9d1f4c93-aa49-453e-8b97-73cb8028bbba response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75672024-12-20T22:23:08.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c83e1623-fa3c-485c-9c69-9a10f74566e0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75682024-12-20T22:23:08.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c83e1623-fa3c-485c-9c69-9a10f74566e0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75692024-12-20T22:23:08.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c83e1623-fa3c-485c-9c69-9a10f74566e0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75702024-12-20T22:23:09.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf5563f4-6497-47cc-b494-cf24fc36bdf1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75712024-12-20T22:23:09.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf5563f4-6497-47cc-b494-cf24fc36bdf1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75722024-12-20T22:23:09.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf5563f4-6497-47cc-b494-cf24fc36bdf1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75732024-12-20T22:23:10.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 77a06853-5047-4511-b963-a2c010c1214a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75742024-12-20T22:23:10.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 77a06853-5047-4511-b963-a2c010c1214a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75752024-12-20T22:23:10.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 77a06853-5047-4511-b963-a2c010c1214a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75762024-12-20T22:23:10.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 2f5f7ec7-b3a3-4001-a1de-3ce39b462ccc roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
75772024-12-20T22:23:10.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 2f5f7ec7-b3a3-4001-a1de-3ce39b462ccc resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
75782024-12-20T22:23:10.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 2f5f7ec7-b3a3-4001-a1de-3ce39b462ccc response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
75792024-12-20T22:23:10.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 2d944a8f-ac94-43f0-9f6c-165b3e49335e roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
75802024-12-20T22:23:10.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 2d944a8f-ac94-43f0-9f6c-165b3e49335e resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
75812024-12-20T22:23:10.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 2d944a8f-ac94-43f0-9f6c-165b3e49335e response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
75822024-12-20T22:23:11.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b098b8c0-034d-4573-87a5-371ef9251d03 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75832024-12-20T22:23:11.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b098b8c0-034d-4573-87a5-371ef9251d03 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75842024-12-20T22:23:11.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b098b8c0-034d-4573-87a5-371ef9251d03 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75852024-12-20T22:23:12.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6b5dad1d-f2f2-44f6-b868-6ee9d69a43d1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75862024-12-20T22:23:12.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6b5dad1d-f2f2-44f6-b868-6ee9d69a43d1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75872024-12-20T22:23:12.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6b5dad1d-f2f2-44f6-b868-6ee9d69a43d1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75882024-12-20T22:23:13.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8ff06590-7be7-4dc8-b252-e9e05d21bfc8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75892024-12-20T22:23:13.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8ff06590-7be7-4dc8-b252-e9e05d21bfc8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75902024-12-20T22:23:13.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8ff06590-7be7-4dc8-b252-e9e05d21bfc8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
75912024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
75922024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
75932024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75942024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
75952024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75962024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
75972024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
75982024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
75992024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76002024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76012024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76022024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
76032024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
76042024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
76052024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76062024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76072024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
76082024-12-20T22:23:13.443ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
76092024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76102024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
76112024-12-20T22:23:13.443ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76122024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
76132024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76142024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
76152024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
76162024-12-20T22:23:13.443ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
76172024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76182024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76192024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
76202024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
76212024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76222024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
76232024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76242024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76252024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
76262024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
76272024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76282024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
76292024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76302024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
76312024-12-20T22:23:13.444ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:13:13.443825611 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
76322024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
76332024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
76342024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
76352024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76362024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
76372024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76382024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
76392024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
76402024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
76412024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
76422024-12-20T22:23:13.444ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
76432024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76442024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
76452024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.79\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
76462024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76472024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
76482024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
76492024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76502024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
76512024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76522024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76532024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
76542024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76552024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76562024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76572024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76582024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76592024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76602024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76612024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76622024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76632024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76642024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76652024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76662024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76672024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
76682024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76692024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76702024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76712024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76722024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76732024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76742024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76752024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76762024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76772024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76782024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76792024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76802024-12-20T22:23:13.444ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 371569779 } })
76812024-12-20T22:23:13.444ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 371607560 } })
76822024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76832024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76842024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76852024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76862024-12-20T22:23:13.444ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76872024-12-20T22:23:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76882024-12-20T22:23:13.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76892024-12-20T22:23:13.445ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
76902024-12-20T22:23:13.445ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.407394ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
76912024-12-20T22:23:13.445ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
76922024-12-20T22:23:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76932024-12-20T22:23:13.445ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.561916ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
76942024-12-20T22:23:13.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76952024-12-20T22:23:13.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76962024-12-20T22:23:13.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76972024-12-20T22:23:13.448ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.838999ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76982024-12-20T22:23:13.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76992024-12-20T22:23:13.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77002024-12-20T22:23:13.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77012024-12-20T22:23:13.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77022024-12-20T22:23:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77032024-12-20T22:23:13.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77042024-12-20T22:23:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77052024-12-20T22:23:13.451ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77062024-12-20T22:23:13.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77072024-12-20T22:23:13.452ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 379808942 } })
77082024-12-20T22:23:13.452ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77092024-12-20T22:23:13.453ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77102024-12-20T22:23:13.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77112024-12-20T22:23:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77122024-12-20T22:23:13.453ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
77132024-12-20T22:23:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
77142024-12-20T22:23:13.453ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77152024-12-20T22:23:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77162024-12-20T22:23:13.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77172024-12-20T22:23:13.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77182024-12-20T22:23:13.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77192024-12-20T22:23:13.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77202024-12-20T22:23:13.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77212024-12-20T22:23:13.455ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77222024-12-20T22:23:13.455ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:13:13.443825611 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
77232024-12-20T22:23:13.455ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.038002ms iteration = 10 status = {"expiration":"2024-12-20T22:13:13.443825611Z","pruned":[]}
77242024-12-20T22:23:13.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77252024-12-20T22:23:13.457ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.93616ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
77262024-12-20T22:23:13.459ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 385908133 } })
77272024-12-20T22:23:13.459ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
77282024-12-20T22:23:13.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77292024-12-20T22:23:13.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77302024-12-20T22:23:13.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77312024-12-20T22:23:13.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77322024-12-20T22:23:13.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77332024-12-20T22:23:13.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77342024-12-20T22:23:13.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77352024-12-20T22:23:13.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77362024-12-20T22:23:13.467ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77372024-12-20T22:23:13.469ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77382024-12-20T22:23:13.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.433246ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77392024-12-20T22:23:13.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77402024-12-20T22:23:13.470ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77412024-12-20T22:23:13.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77422024-12-20T22:23:13.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77432024-12-20T22:23:13.472ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77442024-12-20T22:23:13.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77452024-12-20T22:23:13.474ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77462024-12-20T22:23:13.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77472024-12-20T22:23:13.478ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77482024-12-20T22:23:13.479ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 406148857 } })
77492024-12-20T22:23:13.479ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
77502024-12-20T22:23:13.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77512024-12-20T22:23:13.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.69274ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
77522024-12-20T22:23:13.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77532024-12-20T22:23:13.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77542024-12-20T22:23:13.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77552024-12-20T22:23:13.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77562024-12-20T22:23:13.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77572024-12-20T22:23:13.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77582024-12-20T22:23:13.501ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77592024-12-20T22:23:13.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77602024-12-20T22:23:13.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77612024-12-20T22:23:13.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77622024-12-20T22:23:13.508ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77632024-12-20T22:23:13.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77642024-12-20T22:23:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77652024-12-20T22:23:13.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77662024-12-20T22:23:13.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77672024-12-20T22:23:13.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77682024-12-20T22:23:13.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77692024-12-20T22:23:13.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77702024-12-20T22:23:13.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77712024-12-20T22:23:13.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77722024-12-20T22:23:13.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77732024-12-20T22:23:13.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77742024-12-20T22:23:13.517ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
77752024-12-20T22:23:13.517ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
77762024-12-20T22:23:13.517ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.949774ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
77772024-12-20T22:23:13.518ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77782024-12-20T22:23:13.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77792024-12-20T22:23:13.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77802024-12-20T22:23:13.520ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77812024-12-20T22:23:13.522ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.46578ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
77822024-12-20T22:23:13.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
77832024-12-20T22:23:13.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77842024-12-20T22:23:13.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77852024-12-20T22:23:13.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77862024-12-20T22:23:13.524ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77872024-12-20T22:23:13.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77882024-12-20T22:23:13.524ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77892024-12-20T22:23:13.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77902024-12-20T22:23:13.527ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77912024-12-20T22:23:13.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77922024-12-20T22:23:13.532ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77932024-12-20T22:23:13.532ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.926024ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77942024-12-20T22:23:13.533ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77952024-12-20T22:23:13.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77962024-12-20T22:23:13.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77972024-12-20T22:23:13.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
77982024-12-20T22:23:13.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77992024-12-20T22:23:13.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78002024-12-20T22:23:13.543ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
78012024-12-20T22:23:13.543ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
78022024-12-20T22:23:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 99.638783ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
78032024-12-20T22:23:13.543ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78042024-12-20T22:23:13.543ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78052024-12-20T22:23:13.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78062024-12-20T22:23:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78072024-12-20T22:23:13.546ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
78082024-12-20T22:23:13.546ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
78092024-12-20T22:23:13.546ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
78102024-12-20T22:23:13.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78112024-12-20T22:23:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78122024-12-20T22:23:13.549ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78132024-12-20T22:23:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78142024-12-20T22:23:13.551ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78152024-12-20T22:23:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78162024-12-20T22:23:13.559ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
78172024-12-20T22:23:13.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78182024-12-20T22:23:13.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78192024-12-20T22:23:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78202024-12-20T22:23:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78212024-12-20T22:23:13.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 143.734317ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78222024-12-20T22:23:13.591ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
78232024-12-20T22:23:13.595ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
78242024-12-20T22:23:13.595ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
78252024-12-20T22:23:13.596ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
78262024-12-20T22:23:13.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78272024-12-20T22:23:13.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78282024-12-20T22:23:13.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78292024-12-20T22:23:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78302024-12-20T22:23:13.616ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
78312024-12-20T22:23:13.616ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78322024-12-20T22:23:13.616ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f89e4fa-6b16-443c-994e-49844e0c2dd2", "content-length": "26", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
78332024-12-20T22:23:13.616ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78342024-12-20T22:23:13.618ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78352024-12-20T22:23:13.622ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
78362024-12-20T22:23:13.622ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78372024-12-20T22:23:13.622ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09eb6384-780d-4d0b-9a3b-eb2ae8f6cdea", "content-length": "26", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
78382024-12-20T22:23:13.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78392024-12-20T22:23:13.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
78402024-12-20T22:23:13.636ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
78412024-12-20T22:23:13.636ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78422024-12-20T22:23:13.636ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "519d3ca6-1c38-4cad-b46e-67bc262e9bda", "content-length": "26", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
78432024-12-20T22:23:13.636ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78442024-12-20T22:23:13.638ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78452024-12-20T22:23:13.687ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78462024-12-20T22:23:13.687ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78472024-12-20T22:23:13.687ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0d124d6-7f3c-4915-9890-77cdf5d4ca0b", "content-length": "372", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
78482024-12-20T22:23:13.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78492024-12-20T22:23:13.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78502024-12-20T22:23:13.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78512024-12-20T22:23:13.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78522024-12-20T22:23:13.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78532024-12-20T22:23:13.694ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 251.177508ms iteration = 5 status = {"nsuccess":5}
78542024-12-20T22:23:13.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78552024-12-20T22:23:13.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78562024-12-20T22:23:13.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78572024-12-20T22:23:13.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78582024-12-20T22:23:13.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78592024-12-20T22:23:13.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78602024-12-20T22:23:13.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78612024-12-20T22:23:13.708ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
78622024-12-20T22:23:13.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 264.754415ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
78632024-12-20T22:23:13.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78642024-12-20T22:23:13.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78652024-12-20T22:23:13.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78662024-12-20T22:23:13.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78672024-12-20T22:23:13.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78682024-12-20T22:23:13.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78692024-12-20T22:23:13.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78702024-12-20T22:23:13.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78712024-12-20T22:23:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
78722024-12-20T22:23:13.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78732024-12-20T22:23:13.732ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78742024-12-20T22:23:13.732ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78752024-12-20T22:23:13.732ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 289.124709ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78762024-12-20T22:23:13.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78772024-12-20T22:23:13.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 289.743016ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78782024-12-20T22:23:13.734ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
78792024-12-20T22:23:13.734ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
78802024-12-20T22:23:13.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78812024-12-20T22:23:13.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78822024-12-20T22:23:13.735ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 291.375082ms iteration = 19 status = 0
78832024-12-20T22:23:13.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78842024-12-20T22:23:13.736ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
78852024-12-20T22:23:13.736ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
78862024-12-20T22:23:13.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78872024-12-20T22:23:13.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78882024-12-20T22:23:13.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78892024-12-20T22:23:13.738ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78902024-12-20T22:23:13.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78912024-12-20T22:23:13.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78922024-12-20T22:23:13.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78932024-12-20T22:23:13.778ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
78942024-12-20T22:23:13.778ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78952024-12-20T22:23:13.778ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2b9d94e2-39e1-42e9-893f-d8af199f13c0", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
78962024-12-20T22:23:13.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78972024-12-20T22:23:13.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78982024-12-20T22:23:13.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78992024-12-20T22:23:13.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79002024-12-20T22:23:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79012024-12-20T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79022024-12-20T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79032024-12-20T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79042024-12-20T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79052024-12-20T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79062024-12-20T22:23:13.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 352.929292ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
79072024-12-20T22:23:13.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79082024-12-20T22:23:13.800ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
79092024-12-20T22:23:13.800ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
79102024-12-20T22:23:13.800ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
79112024-12-20T22:23:13.800ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 356.431837ms iteration = 11 status = {"generation":2}
79122024-12-20T22:23:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79132024-12-20T22:23:13.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79142024-12-20T22:23:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79152024-12-20T22:23:13.803ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
79162024-12-20T22:23:13.803ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79172024-12-20T22:23:13.804ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0d7f957a-4ae6-4099-ae6a-9e52faf0a4c6", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
79182024-12-20T22:23:13.806ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
79192024-12-20T22:23:13.806ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
79202024-12-20T22:23:13.806ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
79212024-12-20T22:23:13.806ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 362.408447ms iteration = 11 status = {"generation":1}
79222024-12-20T22:23:13.806ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 362.812522ms iteration = 20 status = {}
79232024-12-20T22:23:13.813ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
79242024-12-20T22:23:13.814ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b128821-8e12-4600-b148-c965731f22ed", "content-length": "1", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
79252024-12-20T22:23:13.815ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79262024-12-20T22:23:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79272024-12-20T22:23:13.816ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
79282024-12-20T22:23:13.816ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 373.052665ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
79292024-12-20T22:23:13.819ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 375.441059ms iteration = 19 status = null
79302024-12-20T22:23:13.852ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
79312024-12-20T22:23:13.852ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 408.837445ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
79322024-12-20T22:23:13.856ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 413.154188ms iteration = 22 status = {"physical_disks_added":0}
79332024-12-20T22:23:13.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79342024-12-20T22:23:13.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79352024-12-20T22:23:13.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79362024-12-20T22:23:13.874ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79372024-12-20T22:23:13.875ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5e334ae2-4641-4ea9-be70-0828d4004637", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79382024-12-20T22:23:13.875ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79392024-12-20T22:23:13.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79402024-12-20T22:23:13.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79412024-12-20T22:23:13.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79422024-12-20T22:23:13.877ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4e4f2884-4cd6-4160-8fba-2cb95c523a7d", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79432024-12-20T22:23:13.877ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79442024-12-20T22:23:13.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79452024-12-20T22:23:13.879ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79462024-12-20T22:23:13.879ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 435.930818ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
79472024-12-20T22:23:13.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79482024-12-20T22:23:13.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79492024-12-20T22:23:13.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79502024-12-20T22:23:13.884ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
79512024-12-20T22:23:13.885ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8e6f078d-f789-4ad3-8fb1-6b551eb75c65", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79522024-12-20T22:23:13.885ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79532024-12-20T22:23:13.886ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 442.927428ms iteration = 19 status = {}
79542024-12-20T22:23:13.887ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9898748a-3830-42c1-83ff-2ff21a3e33ba", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79552024-12-20T22:23:13.887ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79562024-12-20T22:23:13.889ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5a79d823-b2f8-41b1-b40a-1d342d1aa505", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79572024-12-20T22:23:13.889ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79582024-12-20T22:23:13.891ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79592024-12-20T22:23:13.891ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 447.383833ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
79602024-12-20T22:23:13.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79612024-12-20T22:23:13.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79622024-12-20T22:23:13.955ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
79632024-12-20T22:23:13.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79642024-12-20T22:23:13.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79652024-12-20T22:23:13.966ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79662024-12-20T22:23:13.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "829cbbf8-c6cc-4ecc-af24-b0055ac1c5b3", "content-length": "134", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
79672024-12-20T22:23:13.967ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
79682024-12-20T22:23:13.967ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
79692024-12-20T22:23:13.967ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
79702024-12-20T22:23:13.967ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79712024-12-20T22:23:13.967ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79722024-12-20T22:23:13.967ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79732024-12-20T22:23:13.967ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79742024-12-20T22:23:13.967ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79752024-12-20T22:23:13.967ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79762024-12-20T22:23:13.967ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79772024-12-20T22:23:13.968ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
79782024-12-20T22:23:13.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79792024-12-20T22:23:13.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79802024-12-20T22:23:13.972ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79812024-12-20T22:23:13.973ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "864dde84-fc02-4bc0-81ee-b9c5593fece0", "content-length": "2", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
79822024-12-20T22:23:13.973ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79832024-12-20T22:23:13.973ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a7dfff4-ba02-4398-9981-df059beaef15", "content-length": "52", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
79842024-12-20T22:23:13.973ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
79852024-12-20T22:23:13.973ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79862024-12-20T22:23:14.000ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79872024-12-20T22:23:14.081ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7045053c-e69b-4b32-bb17-9c9db543b3b2", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
79882024-12-20T22:23:14.081ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
79892024-12-20T22:23:14.081ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79902024-12-20T22:23:14.082ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f31866a-eae2-4711-8865-44d0176a22bc", "content-length": "691", "date": "Fri, 20 Dec 2024 22:23:13 GMT"} })
79912024-12-20T22:23:14.082ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
79922024-12-20T22:23:14.082ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
79932024-12-20T22:23:14.082ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
79942024-12-20T22:23:14.082ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f085f14a-a846-4f0a-ae64-957638e69e12", "content-length": "682", "date": "Fri, 20 Dec 2024 22:23:14 GMT"} })
79952024-12-20T22:23:14.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79962024-12-20T22:23:14.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79972024-12-20T22:23:14.083ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 639.94221ms iteration = 19 status = {}
79982024-12-20T22:23:14.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79992024-12-20T22:23:14.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80002024-12-20T22:23:14.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80012024-12-20T22:23:14.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80022024-12-20T22:23:14.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80032024-12-20T22:23:14.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80042024-12-20T22:23:14.098ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 655.144073ms iteration = 19 status = {}
80052024-12-20T22:23:14.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7b171eed-6214-4460-a8f6-d9928f799aa2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80062024-12-20T22:23:14.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7b171eed-6214-4460-a8f6-d9928f799aa2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80072024-12-20T22:23:14.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7b171eed-6214-4460-a8f6-d9928f799aa2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80082024-12-20T22:23:14.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 84b31213-a2c9-4a87-97d3-b6554102fb03 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
80092024-12-20T22:23:14.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 84b31213-a2c9-4a87-97d3-b6554102fb03 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
80102024-12-20T22:23:14.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 84b31213-a2c9-4a87-97d3-b6554102fb03 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
80112024-12-20T22:23:15.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1db826aa-011c-4a15-81ed-6d34e137349c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80122024-12-20T22:23:15.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1db826aa-011c-4a15-81ed-6d34e137349c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80132024-12-20T22:23:15.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1db826aa-011c-4a15-81ed-6d34e137349c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80142024-12-20T22:23:15.689ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1520 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = cdd7d5be-d607-402e-b88b-5e2eb9f56142 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
80152024-12-20T22:23:16.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 38617527-051d-4399-8e46-486317953f62 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80162024-12-20T22:23:16.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 38617527-051d-4399-8e46-486317953f62 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80172024-12-20T22:23:16.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 38617527-051d-4399-8e46-486317953f62 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80182024-12-20T22:23:17.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a6ff4b25-0e73-44f7-9c57-bcbcea84403c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80192024-12-20T22:23:17.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a6ff4b25-0e73-44f7-9c57-bcbcea84403c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80202024-12-20T22:23:17.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a6ff4b25-0e73-44f7-9c57-bcbcea84403c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80212024-12-20T22:23:18.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 74da4eec-3f02-4d29-8bb7-9b6970b2d91a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80222024-12-20T22:23:18.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 74da4eec-3f02-4d29-8bb7-9b6970b2d91a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80232024-12-20T22:23:18.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 74da4eec-3f02-4d29-8bb7-9b6970b2d91a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80242024-12-20T22:23:19.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 48e6430e-cc97-4f22-b8d4-d4452a0261cc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80252024-12-20T22:23:19.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 48e6430e-cc97-4f22-b8d4-d4452a0261cc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80262024-12-20T22:23:19.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 48e6430e-cc97-4f22-b8d4-d4452a0261cc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80272024-12-20T22:23:20.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3889094-5971-41c3-a834-41194e6aaf2d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80282024-12-20T22:23:20.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3889094-5971-41c3-a834-41194e6aaf2d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80292024-12-20T22:23:20.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c3889094-5971-41c3-a834-41194e6aaf2d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80302024-12-20T22:23:21.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0157d7bf-db67-4969-b865-99c38eb8f25c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80312024-12-20T22:23:21.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0157d7bf-db67-4969-b865-99c38eb8f25c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80322024-12-20T22:23:21.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0157d7bf-db67-4969-b865-99c38eb8f25c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80332024-12-20T22:23:22.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e38ae292-2ad2-4a60-ad09-b1287e4b5144 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80342024-12-20T22:23:22.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e38ae292-2ad2-4a60-ad09-b1287e4b5144 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80352024-12-20T22:23:22.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e38ae292-2ad2-4a60-ad09-b1287e4b5144 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80362024-12-20T22:23:23.443ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
80372024-12-20T22:23:23.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
80382024-12-20T22:23:23.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80392024-12-20T22:23:23.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80402024-12-20T22:23:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80412024-12-20T22:23:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80422024-12-20T22:23:23.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80432024-12-20T22:23:23.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80442024-12-20T22:23:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80452024-12-20T22:23:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80462024-12-20T22:23:23.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80472024-12-20T22:23:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80482024-12-20T22:23:23.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80492024-12-20T22:23:23.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80502024-12-20T22:23:23.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80512024-12-20T22:23:23.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
80522024-12-20T22:23:23.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80532024-12-20T22:23:23.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80542024-12-20T22:23:23.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
80552024-12-20T22:23:23.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.957961ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
80562024-12-20T22:23:23.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.272295ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80572024-12-20T22:23:23.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d882d97-f4fa-410e-b3e7-700d6fd584e1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80582024-12-20T22:23:23.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d882d97-f4fa-410e-b3e7-700d6fd584e1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80592024-12-20T22:23:23.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d882d97-f4fa-410e-b3e7-700d6fd584e1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80602024-12-20T22:23:24.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = de21cc3b-b343-4c27-a672-c29e8eb65627 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80612024-12-20T22:23:24.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = de21cc3b-b343-4c27-a672-c29e8eb65627 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80622024-12-20T22:23:24.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = de21cc3b-b343-4c27-a672-c29e8eb65627 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80632024-12-20T22:23:25.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3006ad5c-2c9f-4247-8ef0-92fc1cc6d62b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80642024-12-20T22:23:25.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3006ad5c-2c9f-4247-8ef0-92fc1cc6d62b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80652024-12-20T22:23:25.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3006ad5c-2c9f-4247-8ef0-92fc1cc6d62b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80662024-12-20T22:23:25.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 526dc4e2-7c90-4d1a-8ce7-acce8dc1be0f roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
80672024-12-20T22:23:25.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 526dc4e2-7c90-4d1a-8ce7-acce8dc1be0f resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
80682024-12-20T22:23:25.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 526dc4e2-7c90-4d1a-8ce7-acce8dc1be0f response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
80692024-12-20T22:23:25.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 442c6faa-471e-42c8-9071-de6a2288531e roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
80702024-12-20T22:23:25.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 442c6faa-471e-42c8-9071-de6a2288531e resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
80712024-12-20T22:23:25.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 442c6faa-471e-42c8-9071-de6a2288531e response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
80722024-12-20T22:23:25.689ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1239 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 5c76a469-5fa3-4e40-a523-08f35a92529c response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
80732024-12-20T22:23:26.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0879acbe-23e0-4f91-9b48-30f51e6d4731 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80742024-12-20T22:23:26.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0879acbe-23e0-4f91-9b48-30f51e6d4731 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80752024-12-20T22:23:26.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0879acbe-23e0-4f91-9b48-30f51e6d4731 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80762024-12-20T22:23:27.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7f264901-2d8c-417a-b4a2-78c027188dca roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80772024-12-20T22:23:27.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7f264901-2d8c-417a-b4a2-78c027188dca resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80782024-12-20T22:23:27.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7f264901-2d8c-417a-b4a2-78c027188dca response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80792024-12-20T22:23:28.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3b357e13-c20b-4a61-8fd4-15457f259067 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80802024-12-20T22:23:28.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3b357e13-c20b-4a61-8fd4-15457f259067 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80812024-12-20T22:23:28.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3b357e13-c20b-4a61-8fd4-15457f259067 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80822024-12-20T22:23:29.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b03e03c7-a36b-44a9-8ca4-ba2d64b3c63d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80832024-12-20T22:23:29.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b03e03c7-a36b-44a9-8ca4-ba2d64b3c63d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80842024-12-20T22:23:29.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b03e03c7-a36b-44a9-8ca4-ba2d64b3c63d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80852024-12-20T22:23:30.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0f06645d-6de8-4ccd-9a6a-b94e8915c3ee roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80862024-12-20T22:23:30.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0f06645d-6de8-4ccd-9a6a-b94e8915c3ee resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80872024-12-20T22:23:30.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0f06645d-6de8-4ccd-9a6a-b94e8915c3ee response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80882024-12-20T22:23:31.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d31f3af5-fa66-49d9-9cd2-fc8c7c75888b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80892024-12-20T22:23:31.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d31f3af5-fa66-49d9-9cd2-fc8c7c75888b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80902024-12-20T22:23:31.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d31f3af5-fa66-49d9-9cd2-fc8c7c75888b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80912024-12-20T22:23:32.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 64625d3c-68e0-4be6-8299-681195a2806f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80922024-12-20T22:23:32.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 64625d3c-68e0-4be6-8299-681195a2806f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80932024-12-20T22:23:32.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 64625d3c-68e0-4be6-8299-681195a2806f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
80942024-12-20T22:23:33.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
80952024-12-20T22:23:33.443ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
80962024-12-20T22:23:33.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80972024-12-20T22:23:33.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80982024-12-20T22:23:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80992024-12-20T22:23:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81002024-12-20T22:23:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81012024-12-20T22:23:33.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81022024-12-20T22:23:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81032024-12-20T22:23:33.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81042024-12-20T22:23:33.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81052024-12-20T22:23:33.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81062024-12-20T22:23:33.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81072024-12-20T22:23:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81082024-12-20T22:23:33.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81092024-12-20T22:23:33.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
81102024-12-20T22:23:33.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81112024-12-20T22:23:33.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81122024-12-20T22:23:33.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
81132024-12-20T22:23:33.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.269104ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
81142024-12-20T22:23:33.482ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.985143ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81152024-12-20T22:23:33.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cc7b6b47-c8bc-4d03-840a-fe685f5f765f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81162024-12-20T22:23:33.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cc7b6b47-c8bc-4d03-840a-fe685f5f765f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81172024-12-20T22:23:33.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cc7b6b47-c8bc-4d03-840a-fe685f5f765f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81182024-12-20T22:23:34.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c6bfa12-6864-42d4-aaef-5001845d04d3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81192024-12-20T22:23:34.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c6bfa12-6864-42d4-aaef-5001845d04d3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81202024-12-20T22:23:34.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c6bfa12-6864-42d4-aaef-5001845d04d3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81212024-12-20T22:23:35.690ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 3eb14ad8-34c1-4955-8757-0205720e6687 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
81222024-12-20T22:23:35.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12263f69-8f8e-48f0-a3b0-d87d4487f09b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81232024-12-20T22:23:35.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12263f69-8f8e-48f0-a3b0-d87d4487f09b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81242024-12-20T22:23:35.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12263f69-8f8e-48f0-a3b0-d87d4487f09b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81252024-12-20T22:23:36.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d52fa89a-a479-40fd-b326-54d332fd3b47 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81262024-12-20T22:23:36.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d52fa89a-a479-40fd-b326-54d332fd3b47 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81272024-12-20T22:23:36.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d52fa89a-a479-40fd-b326-54d332fd3b47 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81282024-12-20T22:23:37.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0251cc15-4f72-4071-9120-1713b45470cd roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81292024-12-20T22:23:37.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0251cc15-4f72-4071-9120-1713b45470cd resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81302024-12-20T22:23:37.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0251cc15-4f72-4071-9120-1713b45470cd response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81312024-12-20T22:23:38.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ad88816d-cdcd-4d7e-8ffe-e2f7febace50 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81322024-12-20T22:23:38.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ad88816d-cdcd-4d7e-8ffe-e2f7febace50 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81332024-12-20T22:23:38.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ad88816d-cdcd-4d7e-8ffe-e2f7febace50 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81342024-12-20T22:23:39.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2956cb62-f129-47f0-92f8-e4fa62d29229 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81352024-12-20T22:23:39.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2956cb62-f129-47f0-92f8-e4fa62d29229 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81362024-12-20T22:23:39.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2956cb62-f129-47f0-92f8-e4fa62d29229 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81372024-12-20T22:23:40.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b4ce8775-19e0-4158-996b-4abb2723b896 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
81382024-12-20T22:23:40.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b4ce8775-19e0-4158-996b-4abb2723b896 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
81392024-12-20T22:23:40.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b4ce8775-19e0-4158-996b-4abb2723b896 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
81402024-12-20T22:23:40.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b8f4e8ab-dba6-4756-a440-d3b8dcb710e7 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
81412024-12-20T22:23:40.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b8f4e8ab-dba6-4756-a440-d3b8dcb710e7 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
81422024-12-20T22:23:40.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b8f4e8ab-dba6-4756-a440-d3b8dcb710e7 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
81432024-12-20T22:23:40.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93cf6940-4868-4908-9f1a-43cbaaecb41c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81442024-12-20T22:23:40.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93cf6940-4868-4908-9f1a-43cbaaecb41c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81452024-12-20T22:23:40.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93cf6940-4868-4908-9f1a-43cbaaecb41c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81462024-12-20T22:23:41.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 489e96d7-0e89-4ba9-a036-8cbe594d9583 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81472024-12-20T22:23:41.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 489e96d7-0e89-4ba9-a036-8cbe594d9583 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81482024-12-20T22:23:41.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 489e96d7-0e89-4ba9-a036-8cbe594d9583 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81492024-12-20T22:23:42.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0141fce4-01d6-49b9-a025-85b6cf6287ab roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81502024-12-20T22:23:42.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0141fce4-01d6-49b9-a025-85b6cf6287ab resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81512024-12-20T22:23:42.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0141fce4-01d6-49b9-a025-85b6cf6287ab response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
81522024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
81532024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
81542024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
81552024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81562024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81572024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
81582024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
81592024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81602024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
81612024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
81622024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81632024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
81642024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
81652024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
81662024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81672024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
81682024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
81692024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
81702024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81712024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
81722024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81732024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
81742024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
81752024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81762024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
81772024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81782024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
81792024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
81802024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81812024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
81822024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81832024-12-20T22:23:43.443ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
81842024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81852024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
81862024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81872024-12-20T22:23:43.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81882024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81892024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81902024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81912024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81922024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81932024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81942024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81952024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
81962024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
81972024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81982024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81992024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82002024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82012024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82022024-12-20T22:23:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82032024-12-20T22:23:43.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82042024-12-20T22:23:43.447ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.587126ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
82052024-12-20T22:23:43.448ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82062024-12-20T22:23:43.448ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
82072024-12-20T22:23:43.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82082024-12-20T22:23:43.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82092024-12-20T22:23:43.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82102024-12-20T22:23:43.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82112024-12-20T22:23:43.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82122024-12-20T22:23:43.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 377313617 } })
82132024-12-20T22:23:43.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
82142024-12-20T22:23:43.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82152024-12-20T22:23:43.452ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 379500039 } })
82162024-12-20T22:23:43.453ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
82172024-12-20T22:23:43.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82182024-12-20T22:23:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
82192024-12-20T22:23:43.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82202024-12-20T22:23:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82212024-12-20T22:23:43.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82222024-12-20T22:23:43.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82232024-12-20T22:23:43.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82242024-12-20T22:23:43.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82252024-12-20T22:23:43.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82262024-12-20T22:23:43.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82272024-12-20T22:23:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82282024-12-20T22:23:43.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82292024-12-20T22:23:43.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82302024-12-20T22:23:43.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82312024-12-20T22:23:43.462ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 388696862 } })
82322024-12-20T22:23:43.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82332024-12-20T22:23:43.462ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
82342024-12-20T22:23:43.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82352024-12-20T22:23:43.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
82362024-12-20T22:23:43.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82372024-12-20T22:23:43.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82382024-12-20T22:23:43.496ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
82392024-12-20T22:23:43.496ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.909872ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
82402024-12-20T22:23:43.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.228216ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
82412024-12-20T22:23:43.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82422024-12-20T22:23:43.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82432024-12-20T22:23:43.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82442024-12-20T22:23:43.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82452024-12-20T22:23:43.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82462024-12-20T22:23:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82472024-12-20T22:23:43.510ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.967524ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82482024-12-20T22:23:43.514ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82492024-12-20T22:23:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82502024-12-20T22:23:43.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.646321ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82512024-12-20T22:23:43.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.895884ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
82522024-12-20T22:23:43.520ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82532024-12-20T22:23:43.521ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82542024-12-20T22:23:43.521ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82552024-12-20T22:23:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82562024-12-20T22:23:43.521ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82572024-12-20T22:23:43.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82582024-12-20T22:23:43.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
82592024-12-20T22:23:43.523ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82602024-12-20T22:23:43.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82612024-12-20T22:23:43.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82622024-12-20T22:23:43.526ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82632024-12-20T22:23:43.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82642024-12-20T22:23:43.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82652024-12-20T22:23:43.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
82662024-12-20T22:23:43.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82672024-12-20T22:23:43.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82682024-12-20T22:23:43.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82692024-12-20T22:23:43.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82702024-12-20T22:23:43.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82712024-12-20T22:23:43.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82722024-12-20T22:23:43.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82732024-12-20T22:23:43.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82742024-12-20T22:23:43.554ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82752024-12-20T22:23:43.554ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82762024-12-20T22:23:43.555ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "30bc0859-d302-43ce-997b-12f361bae3bb", "content-length": "26", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
82772024-12-20T22:23:43.555ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82782024-12-20T22:23:43.556ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82792024-12-20T22:23:43.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82802024-12-20T22:23:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82812024-12-20T22:23:43.567ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82822024-12-20T22:23:43.567ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
82832024-12-20T22:23:43.567ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.633034ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
82842024-12-20T22:23:43.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 126.075999ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82852024-12-20T22:23:43.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82862024-12-20T22:23:43.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82872024-12-20T22:23:43.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82882024-12-20T22:23:43.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82892024-12-20T22:23:43.574ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
82902024-12-20T22:23:43.574ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 131.10846ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
82912024-12-20T22:23:43.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82922024-12-20T22:23:43.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
82932024-12-20T22:23:43.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82942024-12-20T22:23:43.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82952024-12-20T22:23:43.579ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 136.15068ms iteration = 20 status = 0
82962024-12-20T22:23:43.594ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 151.167802ms iteration = 23 status = {"physical_disks_added":0}
82972024-12-20T22:23:43.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82982024-12-20T22:23:43.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82992024-12-20T22:23:43.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.03455ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
83002024-12-20T22:23:43.651ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
83012024-12-20T22:23:43.651ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83022024-12-20T22:23:43.652ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3338a36-d9a6-476a-ba38-442e4ecdf78f", "content-length": "26", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83032024-12-20T22:23:43.652ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83042024-12-20T22:23:43.652ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83052024-12-20T22:23:43.652ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83062024-12-20T22:23:43.652ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25f6fbaf-92cb-4667-b810-3ff8813bb1f4", "content-length": "26", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83072024-12-20T22:23:43.652ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83082024-12-20T22:23:43.654ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83092024-12-20T22:23:43.654ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
83102024-12-20T22:23:43.659ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
83112024-12-20T22:23:43.659ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d820542-b94e-4701-bc77-871c9d209c6d", "content-length": "1", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83122024-12-20T22:23:43.661ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83132024-12-20T22:23:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83142024-12-20T22:23:43.683ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83152024-12-20T22:23:43.683ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83162024-12-20T22:23:43.684ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a11e9f2-9449-4deb-bc9e-e97bdd92c18b", "content-length": "372", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83172024-12-20T22:23:43.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83182024-12-20T22:23:43.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83192024-12-20T22:23:43.685ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 241.858685ms iteration = 20 status = null
83202024-12-20T22:23:43.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83212024-12-20T22:23:43.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83222024-12-20T22:23:43.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83232024-12-20T22:23:43.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83242024-12-20T22:23:43.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83252024-12-20T22:23:43.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83262024-12-20T22:23:43.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83272024-12-20T22:23:43.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83282024-12-20T22:23:43.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83292024-12-20T22:23:43.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83302024-12-20T22:23:43.701ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 258.052207ms iteration = 20 status = {}
83312024-12-20T22:23:43.729ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
83322024-12-20T22:23:43.729ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83332024-12-20T22:23:43.729ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "727ec3d0-3d27-4610-bc70-ca718c485786", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83342024-12-20T22:23:43.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83352024-12-20T22:23:43.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83362024-12-20T22:23:43.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83372024-12-20T22:23:43.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83382024-12-20T22:23:43.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83392024-12-20T22:23:43.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83402024-12-20T22:23:43.738ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83412024-12-20T22:23:43.738ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83422024-12-20T22:23:43.738ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1ab41125-28f7-4fa8-9bc4-8a945a0dd0ec", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83432024-12-20T22:23:43.740ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.817337ms iteration = 21 status = {}
83442024-12-20T22:23:43.741ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
83452024-12-20T22:23:43.741ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf03384e-3987-4676-a311-a3d4413fa73e", "content-length": "691", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83462024-12-20T22:23:43.741ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
83472024-12-20T22:23:43.741ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
83482024-12-20T22:23:43.741ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
83492024-12-20T22:23:43.743ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 300.485344ms iteration = 20 status = {}
83502024-12-20T22:23:43.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83512024-12-20T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83522024-12-20T22:23:43.798ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
83532024-12-20T22:23:43.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83542024-12-20T22:23:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83552024-12-20T22:23:43.807ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
83562024-12-20T22:23:43.807ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbf7ecc7-2df2-4e0f-a6c0-3d6f1f89b43c", "content-length": "134", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83572024-12-20T22:23:43.807ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
83582024-12-20T22:23:43.808ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
83592024-12-20T22:23:43.808ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
83602024-12-20T22:23:43.808ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83612024-12-20T22:23:43.808ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83622024-12-20T22:23:43.808ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83632024-12-20T22:23:43.808ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83642024-12-20T22:23:43.808ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83652024-12-20T22:23:43.808ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83662024-12-20T22:23:43.808ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83672024-12-20T22:23:43.808ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
83682024-12-20T22:23:43.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83692024-12-20T22:23:43.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83702024-12-20T22:23:43.810ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83712024-12-20T22:23:43.810ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e470013-eaa8-431d-a3cf-4e8209b576a5", "content-length": "2", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83722024-12-20T22:23:43.810ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83732024-12-20T22:23:43.810ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b0c17e0-666e-4f9b-869c-e417cd2aecc3", "content-length": "52", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83742024-12-20T22:23:43.810ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
83752024-12-20T22:23:43.810ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83762024-12-20T22:23:43.922ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "90e16aee-680a-46cb-8eaa-d3125aee50a7", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83772024-12-20T22:23:43.922ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
83782024-12-20T22:23:43.922ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83792024-12-20T22:23:43.922ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "44a95bc0-ab36-4143-8044-da7067a8e8da", "content-length": "682", "date": "Fri, 20 Dec 2024 22:23:43 GMT"} })
83802024-12-20T22:23:43.922ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83812024-12-20T22:23:43.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83822024-12-20T22:23:43.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83832024-12-20T22:23:43.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83842024-12-20T22:23:43.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a7256a0d-610f-402b-8b47-4e357e578b97 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
83852024-12-20T22:23:43.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83862024-12-20T22:23:43.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a7256a0d-610f-402b-8b47-4e357e578b97 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
83872024-12-20T22:23:43.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83882024-12-20T22:23:43.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a7256a0d-610f-402b-8b47-4e357e578b97 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
83892024-12-20T22:23:43.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83902024-12-20T22:23:43.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83912024-12-20T22:23:43.939ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 495.531047ms iteration = 20 status = {}
83922024-12-20T22:23:44.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 2204541b-eda9-4fd5-adf5-6fc1f187fdd6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
83932024-12-20T22:23:44.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 2204541b-eda9-4fd5-adf5-6fc1f187fdd6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
83942024-12-20T22:23:44.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 2204541b-eda9-4fd5-adf5-6fc1f187fdd6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
83952024-12-20T22:23:44.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b248b117-4684-4b41-9d1c-516d9e56827d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
83962024-12-20T22:23:44.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b248b117-4684-4b41-9d1c-516d9e56827d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
83972024-12-20T22:23:44.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b248b117-4684-4b41-9d1c-516d9e56827d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
83982024-12-20T22:23:45.689ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1464 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 279f94b7-f95e-4d41-a590-0284f2c272dd response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
83992024-12-20T22:23:45.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6f753421-f513-4d91-ba0e-c565ee0c18de roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84002024-12-20T22:23:45.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6f753421-f513-4d91-ba0e-c565ee0c18de resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84012024-12-20T22:23:45.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6f753421-f513-4d91-ba0e-c565ee0c18de response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84022024-12-20T22:23:46.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0ed4adcc-627b-40d5-8acf-206019cea442 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84032024-12-20T22:23:46.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0ed4adcc-627b-40d5-8acf-206019cea442 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84042024-12-20T22:23:46.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0ed4adcc-627b-40d5-8acf-206019cea442 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84052024-12-20T22:23:48.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8c505a8-3fb5-41df-811c-8efc56e0ab52 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84062024-12-20T22:23:48.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8c505a8-3fb5-41df-811c-8efc56e0ab52 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84072024-12-20T22:23:48.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8c505a8-3fb5-41df-811c-8efc56e0ab52 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84082024-12-20T22:23:49.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a2d88fae-b85e-49d7-b283-76975905371e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84092024-12-20T22:23:49.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a2d88fae-b85e-49d7-b283-76975905371e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84102024-12-20T22:23:49.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a2d88fae-b85e-49d7-b283-76975905371e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84112024-12-20T22:23:50.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9f022e2b-f5aa-4890-88b3-9846b71cc68a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84122024-12-20T22:23:50.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9f022e2b-f5aa-4890-88b3-9846b71cc68a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84132024-12-20T22:23:50.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9f022e2b-f5aa-4890-88b3-9846b71cc68a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84142024-12-20T22:23:51.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 79fd3e68-b423-477c-9afb-46270391ab5a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84152024-12-20T22:23:51.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 79fd3e68-b423-477c-9afb-46270391ab5a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84162024-12-20T22:23:51.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 79fd3e68-b423-477c-9afb-46270391ab5a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84172024-12-20T22:23:52.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 473c577e-894f-430f-8d1e-a97e05e57ad6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84182024-12-20T22:23:52.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 473c577e-894f-430f-8d1e-a97e05e57ad6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84192024-12-20T22:23:52.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 473c577e-894f-430f-8d1e-a97e05e57ad6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84202024-12-20T22:23:53.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 87926c38-0e41-4824-9db2-b08103dcdd14 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84212024-12-20T22:23:53.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 87926c38-0e41-4824-9db2-b08103dcdd14 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84222024-12-20T22:23:53.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 87926c38-0e41-4824-9db2-b08103dcdd14 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84232024-12-20T22:23:53.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
84242024-12-20T22:23:53.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84252024-12-20T22:23:53.443ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
84262024-12-20T22:23:53.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84272024-12-20T22:23:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84282024-12-20T22:23:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84292024-12-20T22:23:53.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84302024-12-20T22:23:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84312024-12-20T22:23:53.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84322024-12-20T22:23:53.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84332024-12-20T22:23:53.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84342024-12-20T22:23:53.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84352024-12-20T22:23:53.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84362024-12-20T22:23:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84372024-12-20T22:23:53.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84382024-12-20T22:23:53.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
84392024-12-20T22:23:53.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84402024-12-20T22:23:53.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84412024-12-20T22:23:53.468ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
84422024-12-20T22:23:53.468ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.166704ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
84432024-12-20T22:23:53.474ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.80873ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84442024-12-20T22:23:54.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2804bf3a-a4ec-4a03-99d6-d69a9fa98e18 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84452024-12-20T22:23:54.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2804bf3a-a4ec-4a03-99d6-d69a9fa98e18 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84462024-12-20T22:23:54.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2804bf3a-a4ec-4a03-99d6-d69a9fa98e18 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84472024-12-20T22:23:55.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ee9440cd-d5e7-4338-9a84-7ea1205600fa roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84482024-12-20T22:23:55.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ee9440cd-d5e7-4338-9a84-7ea1205600fa resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84492024-12-20T22:23:55.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ee9440cd-d5e7-4338-9a84-7ea1205600fa response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84502024-12-20T22:23:55.690ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1373 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = f2ba6ae8-3df8-44cf-9ec9-92bfa2a904d2 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
84512024-12-20T22:23:56.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6356177-b6cc-46cc-bd5e-f2cda58dc360 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84522024-12-20T22:23:56.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6356177-b6cc-46cc-bd5e-f2cda58dc360 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84532024-12-20T22:23:56.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6356177-b6cc-46cc-bd5e-f2cda58dc360 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84542024-12-20T22:23:57.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d011192e-31fb-4b6c-9915-5fe3135ce22c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84552024-12-20T22:23:57.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d011192e-31fb-4b6c-9915-5fe3135ce22c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84562024-12-20T22:23:57.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d011192e-31fb-4b6c-9915-5fe3135ce22c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84572024-12-20T22:23:58.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ed251996-a940-4bda-83e0-866d4974d7ed roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84582024-12-20T22:23:58.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ed251996-a940-4bda-83e0-866d4974d7ed resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84592024-12-20T22:23:58.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ed251996-a940-4bda-83e0-866d4974d7ed response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84602024-12-20T22:23:59.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23a93fcb-291e-4e1c-b18a-a8c884dade8a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84612024-12-20T22:23:59.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23a93fcb-291e-4e1c-b18a-a8c884dade8a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84622024-12-20T22:23:59.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23a93fcb-291e-4e1c-b18a-a8c884dade8a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84632024-12-20T22:24:00.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f33333b-fb5e-49a3-afdd-7e4978c9b3d6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84642024-12-20T22:24:00.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f33333b-fb5e-49a3-afdd-7e4978c9b3d6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84652024-12-20T22:24:00.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f33333b-fb5e-49a3-afdd-7e4978c9b3d6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84662024-12-20T22:24:01.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 286d08fb-100c-4b44-a0e9-f7109c7abec5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84672024-12-20T22:24:01.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 286d08fb-100c-4b44-a0e9-f7109c7abec5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84682024-12-20T22:24:01.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 286d08fb-100c-4b44-a0e9-f7109c7abec5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84692024-12-20T22:24:02.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1462f2a9-4263-460d-ada7-34b9bab1755c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84702024-12-20T22:24:02.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1462f2a9-4263-460d-ada7-34b9bab1755c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84712024-12-20T22:24:02.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1462f2a9-4263-460d-ada7-34b9bab1755c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84722024-12-20T22:24:03.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 965e70ea-2e03-4078-8bd8-e8d057d5dd79 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84732024-12-20T22:24:03.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 965e70ea-2e03-4078-8bd8-e8d057d5dd79 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84742024-12-20T22:24:03.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 965e70ea-2e03-4078-8bd8-e8d057d5dd79 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84752024-12-20T22:24:03.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
84762024-12-20T22:24:03.443ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
84772024-12-20T22:24:03.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84782024-12-20T22:24:03.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84792024-12-20T22:24:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84802024-12-20T22:24:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84812024-12-20T22:24:03.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84822024-12-20T22:24:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84832024-12-20T22:24:03.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84842024-12-20T22:24:03.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.812489ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84852024-12-20T22:24:03.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84862024-12-20T22:24:03.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84872024-12-20T22:24:03.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84882024-12-20T22:24:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84892024-12-20T22:24:03.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84902024-12-20T22:24:03.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84912024-12-20T22:24:03.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
84922024-12-20T22:24:03.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84932024-12-20T22:24:03.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84942024-12-20T22:24:03.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
84952024-12-20T22:24:03.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.045262ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
84962024-12-20T22:24:04.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f73673d6-c33e-41ce-a805-7862470702af roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84972024-12-20T22:24:04.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f73673d6-c33e-41ce-a805-7862470702af resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84982024-12-20T22:24:04.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f73673d6-c33e-41ce-a805-7862470702af response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
84992024-12-20T22:24:05.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 46c65fd1-cbb5-49ba-b72d-c4b9eab14ed7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85002024-12-20T22:24:05.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 46c65fd1-cbb5-49ba-b72d-c4b9eab14ed7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85012024-12-20T22:24:05.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 46c65fd1-cbb5-49ba-b72d-c4b9eab14ed7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85022024-12-20T22:24:05.690ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1476 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 7bf1a50d-f3bc-4c0b-8ac2-c699dfc70d2e response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
85032024-12-20T22:24:06.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 43fbe5bf-228e-4c57-8c4f-02561b635de0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85042024-12-20T22:24:06.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 43fbe5bf-228e-4c57-8c4f-02561b635de0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85052024-12-20T22:24:06.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 43fbe5bf-228e-4c57-8c4f-02561b635de0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85062024-12-20T22:24:07.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 65bbeffd-0eed-4f15-ac5e-4ef0cf2c2cfc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85072024-12-20T22:24:07.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 65bbeffd-0eed-4f15-ac5e-4ef0cf2c2cfc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85082024-12-20T22:24:07.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 65bbeffd-0eed-4f15-ac5e-4ef0cf2c2cfc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85092024-12-20T22:24:08.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d11a22e8-70de-487a-9758-354bb4cd12cf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85102024-12-20T22:24:08.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d11a22e8-70de-487a-9758-354bb4cd12cf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85112024-12-20T22:24:08.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d11a22e8-70de-487a-9758-354bb4cd12cf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85122024-12-20T22:24:09.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15b1594b-6e5f-43f5-9393-0b8e261bc88a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85132024-12-20T22:24:09.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15b1594b-6e5f-43f5-9393-0b8e261bc88a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85142024-12-20T22:24:09.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15b1594b-6e5f-43f5-9393-0b8e261bc88a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85152024-12-20T22:24:10.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a187be5c-f3f2-4a1d-b6b7-5dd1e885815a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85162024-12-20T22:24:10.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a187be5c-f3f2-4a1d-b6b7-5dd1e885815a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85172024-12-20T22:24:10.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a187be5c-f3f2-4a1d-b6b7-5dd1e885815a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85182024-12-20T22:24:11.399ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:65509
85192024-12-20T22:24:11.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65509 req_id = 075368f3-00c9-4607-a64b-2bdac602b1c0 roles = RoleSet { roles: {} } uri = /metrics/producers
85202024-12-20T22:24:11.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65509 req_id = 075368f3-00c9-4607-a64b-2bdac602b1c0 resource = Database result = Ok(()) uri = /metrics/producers
85212024-12-20T22:24:11.440ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 409c06a2-2340-44a9-a04f-6817610bd642
85222024-12-20T22:24:11.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40821 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65509 req_id = 075368f3-00c9-4607-a64b-2bdac602b1c0 response_code = 201 uri = /metrics/producers
85232024-12-20T22:24:11.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5a61f01c-6bfe-4c5d-8f2e-4d1dbc92b575 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85242024-12-20T22:24:11.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5a61f01c-6bfe-4c5d-8f2e-4d1dbc92b575 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85252024-12-20T22:24:11.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5a61f01c-6bfe-4c5d-8f2e-4d1dbc92b575 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85262024-12-20T22:24:12.396ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47031
85272024-12-20T22:24:12.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47031 req_id = eaca8e1f-8069-4400-a50b-13d9e61dddd6 roles = RoleSet { roles: {} } uri = /metrics/producers
85282024-12-20T22:24:12.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47031 req_id = eaca8e1f-8069-4400-a50b-13d9e61dddd6 resource = Database result = Ok(()) uri = /metrics/producers
85292024-12-20T22:24:12.437ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 1cf20796-1e8a-4632-b82f-1c78cae2c84a
85302024-12-20T22:24:12.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40826 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47031 req_id = eaca8e1f-8069-4400-a50b-13d9e61dddd6 response_code = 201 uri = /metrics/producers
85312024-12-20T22:24:12.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f436ca17-744f-43af-a7f7-3ffc5c2ba3ed roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85322024-12-20T22:24:12.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f436ca17-744f-43af-a7f7-3ffc5c2ba3ed resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85332024-12-20T22:24:12.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f436ca17-744f-43af-a7f7-3ffc5c2ba3ed response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
85342024-12-20T22:24:13.443ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
85352024-12-20T22:24:13.443ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
85362024-12-20T22:24:13.443ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:14:13.443905876 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
85372024-12-20T22:24:13.443ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
85382024-12-20T22:24:13.443ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
85392024-12-20T22:24:13.443ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
85402024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
85412024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
85422024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85432024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85442024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
85452024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85462024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
85472024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85482024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
85492024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
85502024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
85512024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
85522024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
85532024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85542024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85552024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
85562024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85572024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85582024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
85592024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
85602024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85612024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
85622024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85632024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
85642024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
85652024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85662024-12-20T22:24:13.444ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85672024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85682024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
85692024-12-20T22:24:13.444ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
85702024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.471\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
85712024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
85722024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
85732024-12-20T22:24:13.444ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
85742024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
85752024-12-20T22:24:13.444ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
85762024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85772024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
85782024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
85792024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
85802024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85812024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85822024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85832024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
85842024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
85852024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85862024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
85872024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85882024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
85892024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85902024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
85912024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
85922024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
85932024-12-20T22:24:13.444ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
85942024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
85952024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
85962024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85972024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
85982024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
85992024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
86002024-12-20T22:24:13.444ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
86012024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86022024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
86032024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
86042024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86052024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
86062024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86072024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
86082024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
86092024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
86102024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86112024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86122024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86132024-12-20T22:24:13.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86142024-12-20T22:24:13.445ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
86152024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86162024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86172024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
86182024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86192024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86202024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86212024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86222024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86232024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
86242024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86252024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
86262024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86272024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
86282024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86292024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86302024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86312024-12-20T22:24:13.445ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 371492058 } })
86322024-12-20T22:24:13.445ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 371726881 } })
86332024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
86342024-12-20T22:24:13.445ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.886209ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
86352024-12-20T22:24:13.446ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
86362024-12-20T22:24:13.446ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.808569ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
86372024-12-20T22:24:13.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86382024-12-20T22:24:13.448ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86392024-12-20T22:24:13.448ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:14:13.443905876 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
86402024-12-20T22:24:13.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.358393ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
86412024-12-20T22:24:13.448ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.435364ms iteration = 11 status = {"expiration":"2024-12-20T22:14:13.443905876Z","pruned":[]}
86422024-12-20T22:24:13.448ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.684067ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
86432024-12-20T22:24:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86442024-12-20T22:24:13.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86452024-12-20T22:24:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86462024-12-20T22:24:13.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86472024-12-20T22:24:13.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
86482024-12-20T22:24:13.451ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86492024-12-20T22:24:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86502024-12-20T22:24:13.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86512024-12-20T22:24:13.452ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 378309837 } })
86522024-12-20T22:24:13.452ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
86532024-12-20T22:24:13.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86542024-12-20T22:24:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
86552024-12-20T22:24:13.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86562024-12-20T22:24:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86572024-12-20T22:24:13.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86582024-12-20T22:24:13.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86592024-12-20T22:24:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86602024-12-20T22:24:13.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86612024-12-20T22:24:13.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86622024-12-20T22:24:13.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86632024-12-20T22:24:13.464ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 390231607 } })
86642024-12-20T22:24:13.464ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
86652024-12-20T22:24:13.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86662024-12-20T22:24:13.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86672024-12-20T22:24:13.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86682024-12-20T22:24:13.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
86692024-12-20T22:24:13.470ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86702024-12-20T22:24:13.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86712024-12-20T22:24:13.478ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86722024-12-20T22:24:13.478ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 33.868771ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
86732024-12-20T22:24:13.478ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86742024-12-20T22:24:13.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86752024-12-20T22:24:13.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86762024-12-20T22:24:13.480ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
86772024-12-20T22:24:13.480ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86782024-12-20T22:24:13.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86792024-12-20T22:24:13.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
86802024-12-20T22:24:13.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86812024-12-20T22:24:13.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86822024-12-20T22:24:13.485ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86832024-12-20T22:24:13.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86842024-12-20T22:24:13.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86852024-12-20T22:24:13.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86862024-12-20T22:24:13.486ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86872024-12-20T22:24:13.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86882024-12-20T22:24:13.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86892024-12-20T22:24:13.489ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86902024-12-20T22:24:13.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86912024-12-20T22:24:13.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86922024-12-20T22:24:13.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86932024-12-20T22:24:13.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86942024-12-20T22:24:13.497ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86952024-12-20T22:24:13.497ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
86962024-12-20T22:24:13.497ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
86972024-12-20T22:24:13.497ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
86982024-12-20T22:24:13.497ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86992024-12-20T22:24:13.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87002024-12-20T22:24:13.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
87012024-12-20T22:24:13.501ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87022024-12-20T22:24:13.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87032024-12-20T22:24:13.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87042024-12-20T22:24:13.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87052024-12-20T22:24:13.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87062024-12-20T22:24:13.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87072024-12-20T22:24:13.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87082024-12-20T22:24:13.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87092024-12-20T22:24:13.506ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 432333231 } })
87102024-12-20T22:24:13.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87112024-12-20T22:24:13.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87122024-12-20T22:24:13.506ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
87132024-12-20T22:24:13.510ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
87142024-12-20T22:24:13.511ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = dce026d8-949b-4c30-b497-79cd3f165bfe
87152024-12-20T22:24:13.511ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 80341a73-07e8-4bdc-9fa3-5c6d1e55c15f
87162024-12-20T22:24:13.515ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(0fe6a59a-9764-45bc-8e04-723ce215826c, 0), (a4381281-ebc2-49dc-8d1d-0b565821b413, 0), (827a8975-6ac8-4ce6-bdc0-f897bda4ec65, 0), (cb6d72f9-f6a0-4e86-9957-228ff2f33563, 0)] collection_id = 0fe6a59a-9764-45bc-8e04-723ce215826c
87172024-12-20T22:24:13.515ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
87182024-12-20T22:24:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
87192024-12-20T22:24:13.515ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87202024-12-20T22:24:13.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87212024-12-20T22:24:13.515ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
87222024-12-20T22:24:13.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87232024-12-20T22:24:13.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87242024-12-20T22:24:13.517ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 4193ea74-2aa4-4495-849f-138695fb085c
87252024-12-20T22:24:13.517ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 4193ea74-2aa4-4495-849f-138695fb085c
87262024-12-20T22:24:13.517ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 80341a73-07e8-4bdc-9fa3-5c6d1e55c15f
87272024-12-20T22:24:13.517ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = dce026d8-949b-4c30-b497-79cd3f165bfe
87282024-12-20T22:24:13.517ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 73.56798ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
87292024-12-20T22:24:13.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87302024-12-20T22:24:13.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87312024-12-20T22:24:13.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87322024-12-20T22:24:13.521ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87332024-12-20T22:24:13.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87342024-12-20T22:24:13.523ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.285248ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
87352024-12-20T22:24:13.523ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87362024-12-20T22:24:13.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87372024-12-20T22:24:13.524ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87382024-12-20T22:24:13.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87392024-12-20T22:24:13.532ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87402024-12-20T22:24:13.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87412024-12-20T22:24:13.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.783973ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87422024-12-20T22:24:13.538ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87432024-12-20T22:24:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
87442024-12-20T22:24:13.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87452024-12-20T22:24:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87462024-12-20T22:24:13.543ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87472024-12-20T22:24:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87482024-12-20T22:24:13.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87492024-12-20T22:24:13.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87502024-12-20T22:24:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87512024-12-20T22:24:13.546ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
87522024-12-20T22:24:13.546ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
87532024-12-20T22:24:13.546ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 102.462681ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
87542024-12-20T22:24:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
87552024-12-20T22:24:13.547ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87562024-12-20T22:24:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87572024-12-20T22:24:13.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87582024-12-20T22:24:13.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87592024-12-20T22:24:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87602024-12-20T22:24:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87612024-12-20T22:24:13.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87622024-12-20T22:24:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87632024-12-20T22:24:13.564ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
87642024-12-20T22:24:13.564ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
87652024-12-20T22:24:13.564ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
87662024-12-20T22:24:13.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87672024-12-20T22:24:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87682024-12-20T22:24:13.565ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87692024-12-20T22:24:13.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87702024-12-20T22:24:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87712024-12-20T22:24:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87722024-12-20T22:24:13.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87732024-12-20T22:24:13.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e01fe1e3-3985-4771-bef7-0a79080418db roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
87742024-12-20T22:24:13.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e01fe1e3-3985-4771-bef7-0a79080418db resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
87752024-12-20T22:24:13.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87762024-12-20T22:24:13.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87772024-12-20T22:24:13.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87782024-12-20T22:24:13.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87792024-12-20T22:24:13.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87802024-12-20T22:24:13.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87812024-12-20T22:24:13.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87822024-12-20T22:24:13.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87832024-12-20T22:24:13.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87842024-12-20T22:24:13.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e01fe1e3-3985-4771-bef7-0a79080418db response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
87852024-12-20T22:24:13.575ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
87862024-12-20T22:24:13.575ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 131.587054ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
87872024-12-20T22:24:13.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 133.935028ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
87882024-12-20T22:24:13.582ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
87892024-12-20T22:24:13.582ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
87902024-12-20T22:24:13.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87912024-12-20T22:24:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87922024-12-20T22:24:13.584ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
87932024-12-20T22:24:13.584ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
87942024-12-20T22:24:13.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87952024-12-20T22:24:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87962024-12-20T22:24:13.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87972024-12-20T22:24:13.588ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87982024-12-20T22:24:13.588ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
87992024-12-20T22:24:13.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88002024-12-20T22:24:13.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88012024-12-20T22:24:13.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88022024-12-20T22:24:13.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88032024-12-20T22:24:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88042024-12-20T22:24:13.591ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88052024-12-20T22:24:13.591ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88062024-12-20T22:24:13.591ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.755767ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88072024-12-20T22:24:13.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88082024-12-20T22:24:13.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88092024-12-20T22:24:13.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88102024-12-20T22:24:13.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88112024-12-20T22:24:13.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88122024-12-20T22:24:13.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88132024-12-20T22:24:13.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88142024-12-20T22:24:13.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88152024-12-20T22:24:13.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88162024-12-20T22:24:13.597ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
88172024-12-20T22:24:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
88182024-12-20T22:24:13.597ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
88192024-12-20T22:24:13.597ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
88202024-12-20T22:24:13.597ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 153.283873ms iteration = 12 status = {"generation":1}
88212024-12-20T22:24:13.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88222024-12-20T22:24:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88232024-12-20T22:24:13.600ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
88242024-12-20T22:24:13.600ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
88252024-12-20T22:24:13.600ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
88262024-12-20T22:24:13.600ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 155.98377ms iteration = 12 status = {"generation":2}
88272024-12-20T22:24:13.600ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 156.638847ms iteration = 21 status = 0
88282024-12-20T22:24:13.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88292024-12-20T22:24:13.606ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88302024-12-20T22:24:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88312024-12-20T22:24:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88322024-12-20T22:24:13.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88332024-12-20T22:24:13.608ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88342024-12-20T22:24:13.610ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 0fe6a59a-9764-45bc-8e04-723ce215826c file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
88352024-12-20T22:24:13.610ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88362024-12-20T22:24:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
88372024-12-20T22:24:13.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 167.360425ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88382024-12-20T22:24:13.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
88392024-12-20T22:24:13.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88402024-12-20T22:24:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88412024-12-20T22:24:13.612ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88422024-12-20T22:24:13.612ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88432024-12-20T22:24:13.612ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 167.972111ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88442024-12-20T22:24:13.613ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
88452024-12-20T22:24:13.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
88462024-12-20T22:24:13.614ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88472024-12-20T22:24:13.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88482024-12-20T22:24:13.616ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88492024-12-20T22:24:13.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88502024-12-20T22:24:13.618ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88512024-12-20T22:24:13.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88522024-12-20T22:24:13.619ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(a4381281-ebc2-49dc-8d1d-0b565821b413, 0), (827a8975-6ac8-4ce6-bdc0-f897bda4ec65, 0), (cb6d72f9-f6a0-4e86-9957-228ff2f33563, 0)]
88532024-12-20T22:24:13.619ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 546022585 } })
88542024-12-20T22:24:13.620ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88552024-12-20T22:24:13.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88562024-12-20T22:24:13.622ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88572024-12-20T22:24:13.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88582024-12-20T22:24:13.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
88592024-12-20T22:24:13.624ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88602024-12-20T22:24:13.624ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44dd1905-b8ee-4d08-9c1f-0f3f8d802afa", "content-length": "26", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
88612024-12-20T22:24:13.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88622024-12-20T22:24:13.624ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88632024-12-20T22:24:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88642024-12-20T22:24:13.626ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88652024-12-20T22:24:13.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
88662024-12-20T22:24:13.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 182.77055ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
88672024-12-20T22:24:13.627ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
88682024-12-20T22:24:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88692024-12-20T22:24:13.627ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
88702024-12-20T22:24:13.627ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88712024-12-20T22:24:13.627ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95ad16c2-d38f-4b2f-8c92-dc60f5512f8d", "content-length": "26", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
88722024-12-20T22:24:13.627ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88732024-12-20T22:24:13.629ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88742024-12-20T22:24:13.650ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
88752024-12-20T22:24:13.650ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 206.856422ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
88762024-12-20T22:24:13.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88772024-12-20T22:24:13.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 212.054764ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
88782024-12-20T22:24:13.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88792024-12-20T22:24:13.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88802024-12-20T22:24:13.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
88812024-12-20T22:24:13.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88822024-12-20T22:24:13.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88832024-12-20T22:24:13.678ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88842024-12-20T22:24:13.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88852024-12-20T22:24:13.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88862024-12-20T22:24:13.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88872024-12-20T22:24:13.684ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88882024-12-20T22:24:13.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88892024-12-20T22:24:13.687ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 243.289769ms iteration = 24 status = {"physical_disks_added":0}
88902024-12-20T22:24:13.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88912024-12-20T22:24:13.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88922024-12-20T22:24:13.688ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88932024-12-20T22:24:13.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88942024-12-20T22:24:13.690ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88952024-12-20T22:24:13.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88962024-12-20T22:24:13.691ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
88972024-12-20T22:24:13.691ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 247.810384ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
88982024-12-20T22:24:13.692ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88992024-12-20T22:24:13.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
89002024-12-20T22:24:13.697ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89012024-12-20T22:24:13.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89022024-12-20T22:24:13.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89032024-12-20T22:24:13.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89042024-12-20T22:24:13.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89052024-12-20T22:24:13.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89062024-12-20T22:24:13.702ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89072024-12-20T22:24:13.705ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
89082024-12-20T22:24:13.705ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89092024-12-20T22:24:13.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89102024-12-20T22:24:13.710ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89112024-12-20T22:24:13.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89122024-12-20T22:24:13.712ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89132024-12-20T22:24:13.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89142024-12-20T22:24:13.714ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89152024-12-20T22:24:13.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89162024-12-20T22:24:13.716ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89172024-12-20T22:24:13.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89182024-12-20T22:24:13.718ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46732
89192024-12-20T22:24:13.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46732 req_id = 2f6ac97d-3598-4872-8706-b070cd359ac7 roles = RoleSet { roles: {} } uri = /metrics/producers
89202024-12-20T22:24:13.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46732 req_id = 2f6ac97d-3598-4872-8706-b070cd359ac7 resource = Database result = Ok(()) uri = /metrics/producers
89212024-12-20T22:24:13.719ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89222024-12-20T22:24:13.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89232024-12-20T22:24:13.722ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89242024-12-20T22:24:13.754ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89252024-12-20T22:24:13.754ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89262024-12-20T22:24:13.754ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac9a46d3-2ec1-4c2c-931f-be06d7c9dd76", "content-length": "26", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89272024-12-20T22:24:13.754ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89282024-12-20T22:24:13.756ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89292024-12-20T22:24:13.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89302024-12-20T22:24:13.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89312024-12-20T22:24:13.840ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
89322024-12-20T22:24:13.840ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
89332024-12-20T22:24:13.840ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
89342024-12-20T22:24:13.840ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "efcecce5-c1ed-46b8-9544-003c9b2b43e9", "content-length": "476", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89352024-12-20T22:24:13.840ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
89362024-12-20T22:24:13.841ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc10adf9-a5ae-47c4-a844-3e53c89afc4d", "content-length": "734", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89372024-12-20T22:24:13.841ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
89382024-12-20T22:24:13.841ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e8ed8f2-6a23-46d6-992a-a9016df5b415", "content-length": "111", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89392024-12-20T22:24:13.841ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
89402024-12-20T22:24:13.842ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "607afb27-251a-4236-9ee5-dcdbad3afdfb", "content-length": "111", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89412024-12-20T22:24:13.842ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
89422024-12-20T22:24:13.842ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "00b28cf4-c2d0-4daf-a1b8-c01d3decf280", "content-length": "167", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89432024-12-20T22:24:13.842ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
89442024-12-20T22:24:13.842ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "66c21a0c-4c2f-49fd-8ea6-925b4d67691f", "content-length": "167", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89452024-12-20T22:24:13.842ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
89462024-12-20T22:24:13.843ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "799b1166-e8a7-402c-a0b0-1e2837137774", "content-length": "175", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89472024-12-20T22:24:13.843ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
89482024-12-20T22:24:13.843ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c085dbe-7237-43ae-8c8a-5211cecfd56e", "content-length": "175", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89492024-12-20T22:24:13.843ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
89502024-12-20T22:24:13.843ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "46c2d434-b1fb-45c4-8cc9-d8379b07b45c", "content-length": "702", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89512024-12-20T22:24:13.843ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
89522024-12-20T22:24:13.844ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ea13886-532c-4308-8230-716cb3468097", "content-length": "727", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89532024-12-20T22:24:13.844ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
89542024-12-20T22:24:13.844ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c63e0aba-5a99-46f8-a1ed-b987f61a91ad", "content-length": "729", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89552024-12-20T22:24:13.844ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
89562024-12-20T22:24:13.844ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0097b0c0-5c59-43b8-820a-1df530e118bb", "content-length": "728", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89572024-12-20T22:24:13.844ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
89582024-12-20T22:24:13.844ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca261697-70d8-4d81-bffa-fd7afae0336c", "content-length": "722", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89592024-12-20T22:24:13.844ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
89602024-12-20T22:24:13.845ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2331889-1008-4290-870c-a867d4a49498", "content-length": "109", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89612024-12-20T22:24:13.845ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
89622024-12-20T22:24:13.845ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa543d1f-052e-416a-9e9b-6d691782a67d", "content-length": "109", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89632024-12-20T22:24:13.845ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
89642024-12-20T22:24:13.846ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e89d7dc-d5b8-4579-afca-25d7a710d49c", "content-length": "169", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89652024-12-20T22:24:13.846ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
89662024-12-20T22:24:13.846ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ece5376-0437-4135-ad93-f9c6aacac75e", "content-length": "169", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89672024-12-20T22:24:13.846ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
89682024-12-20T22:24:13.846ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf01738c-fe9f-4ec8-9673-72b250894eb1", "content-length": "178", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89692024-12-20T22:24:13.846ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
89702024-12-20T22:24:13.847ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "89f2bf83-b013-418a-bd6c-53e2f8e91982", "content-length": "178", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89712024-12-20T22:24:13.847ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
89722024-12-20T22:24:13.847ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "da449baf-bef6-48f2-b74b-675014eaf253", "content-length": "702", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89732024-12-20T22:24:13.847ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
89742024-12-20T22:24:13.847ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f1ff46c-aa94-42ac-9885-8cc8a38e0b56", "content-length": "727", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89752024-12-20T22:24:13.847ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
89762024-12-20T22:24:13.847ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "57ac9291-307f-49a3-8354-2b2dcef26cc1", "content-length": "729", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89772024-12-20T22:24:13.847ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
89782024-12-20T22:24:13.848ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "46caf6b7-0d57-458f-8ba6-5f782e0cf8a0", "content-length": "728", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89792024-12-20T22:24:13.848ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89802024-12-20T22:24:13.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89812024-12-20T22:24:13.853ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
89822024-12-20T22:24:13.872ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89832024-12-20T22:24:13.872ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89842024-12-20T22:24:13.872ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a3bda19-9395-4dd6-9d29-020b6faecd6b", "content-length": "372", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
89852024-12-20T22:24:13.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89862024-12-20T22:24:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89872024-12-20T22:24:13.875ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89882024-12-20T22:24:13.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89892024-12-20T22:24:13.875ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89902024-12-20T22:24:13.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89912024-12-20T22:24:13.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89922024-12-20T22:24:13.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89932024-12-20T22:24:13.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89942024-12-20T22:24:13.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
89952024-12-20T22:24:13.879ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89962024-12-20T22:24:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89972024-12-20T22:24:13.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89982024-12-20T22:24:13.885ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89992024-12-20T22:24:13.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90002024-12-20T22:24:13.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90012024-12-20T22:24:13.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90022024-12-20T22:24:13.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
90032024-12-20T22:24:13.889ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
90042024-12-20T22:24:13.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
90052024-12-20T22:24:13.898ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90062024-12-20T22:24:13.898ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "062af73f-050b-41cb-9fb3-3b87d32e77d9", "content-length": "1", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
90072024-12-20T22:24:13.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90082024-12-20T22:24:13.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90092024-12-20T22:24:13.903ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 459.391294ms iteration = 21 status = null
90102024-12-20T22:24:13.925ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90112024-12-20T22:24:13.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90122024-12-20T22:24:13.932ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 99b0250f-bcf3-46ae-aea9-2bb2360d90eb
90132024-12-20T22:24:13.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214029 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46732 req_id = 2f6ac97d-3598-4872-8706-b070cd359ac7 response_code = 201 uri = /metrics/producers
90142024-12-20T22:24:13.939ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
90152024-12-20T22:24:13.939ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90162024-12-20T22:24:13.939ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0742adb6-0f66-4e38-a5c1-a99eefce4574", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
90172024-12-20T22:24:13.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90182024-12-20T22:24:13.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90192024-12-20T22:24:14.002ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 558.490041ms iteration = 21 status = {}
90202024-12-20T22:24:14.002ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
90212024-12-20T22:24:14.003ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "dc5c003a-9ac6-468b-89b8-b7049541995f", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90222024-12-20T22:24:14.003ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90232024-12-20T22:24:14.005ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "03152ca4-78da-4036-b6e5-0e625a32671d", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90242024-12-20T22:24:14.005ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90252024-12-20T22:24:14.007ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90262024-12-20T22:24:14.007ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 563.159518ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
90272024-12-20T22:24:14.024ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90282024-12-20T22:24:14.024ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e2923f93-5ae4-4c98-ae97-02aa61e2648d", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90292024-12-20T22:24:14.024ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90302024-12-20T22:24:14.026ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dc3632fd-026a-4558-a9c7-2ee6a28f2092", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90312024-12-20T22:24:14.026ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90322024-12-20T22:24:14.029ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a6df02de-275d-4f66-8418-f8e7fe3aa103", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90332024-12-20T22:24:14.029ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90342024-12-20T22:24:14.031ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90352024-12-20T22:24:14.031ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 587.461392ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
90362024-12-20T22:24:14.039ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90372024-12-20T22:24:14.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90382024-12-20T22:24:14.044ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe43ea68-5210-4cf1-8d55-f7f1d2fd9983", "content-length": "691", "date": "Fri, 20 Dec 2024 22:24:14 GMT"} })
90392024-12-20T22:24:14.044ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
90402024-12-20T22:24:14.044ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
90412024-12-20T22:24:14.044ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
90422024-12-20T22:24:14.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
90432024-12-20T22:24:14.044ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90442024-12-20T22:24:14.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90452024-12-20T22:24:14.046ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 602.421773ms iteration = 21 status = {}
90462024-12-20T22:24:14.056ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
90472024-12-20T22:24:14.056ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
90482024-12-20T22:24:14.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90492024-12-20T22:24:14.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90502024-12-20T22:24:14.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90512024-12-20T22:24:14.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90522024-12-20T22:24:14.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90532024-12-20T22:24:14.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90542024-12-20T22:24:14.059ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
90552024-12-20T22:24:14.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90562024-12-20T22:24:14.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90572024-12-20T22:24:14.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90582024-12-20T22:24:14.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90592024-12-20T22:24:14.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90602024-12-20T22:24:14.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90612024-12-20T22:24:14.062ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90622024-12-20T22:24:14.065ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90632024-12-20T22:24:14.065ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90642024-12-20T22:24:14.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
90652024-12-20T22:24:14.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90662024-12-20T22:24:14.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90672024-12-20T22:24:14.075ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90682024-12-20T22:24:14.075ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f150a2e0-9fad-46c8-a133-a46deda3d58d", "content-length": "134", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
90692024-12-20T22:24:14.075ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90702024-12-20T22:24:14.075ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
90712024-12-20T22:24:14.076ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90722024-12-20T22:24:14.076ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90732024-12-20T22:24:14.076ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90742024-12-20T22:24:14.076ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90752024-12-20T22:24:14.076ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90762024-12-20T22:24:14.076ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90772024-12-20T22:24:14.076ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90782024-12-20T22:24:14.076ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90792024-12-20T22:24:14.076ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
90802024-12-20T22:24:14.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90812024-12-20T22:24:14.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90822024-12-20T22:24:14.077ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 6294325a-a534-458e-bb4d-a82bd38fecc7, kind: Service { id: 57b826de-37e7-4730-9cdb-924c3900cca7 }, name: Name("external-dns-57b826de-37e7-4730-9cdb-924c3900cca7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ce073ed-6a64-4650-b03e-71f0f12930d7, kind: Service { id: 238017a4-2d19-43d3-aa35-92a1ed3e9c3a }, name: Name("external-dns-238017a4-2d19-43d3-aa35-92a1ed3e9c3a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 3607a34f-6331-464f-877d-901d32157481, kind: Service { id: 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c }, name: Name("nexus-73e5bc12-d8f1-466a-967d-9d6c8ff45a8c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7a44818-9125-492c-bc37-8f9c5048ca11, kind: Service { id: bb5e4259-2e9e-45b9-9306-cce16be8e04b }, name: Name("nexus-bb5e4259-2e9e-45b9-9306-cce16be8e04b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b13610c9-f459-4f98-bff6-a9dc2fa99a8a, kind: Service { id: b5e0f45a-5c7c-4d02-b3a0-86311690b334 }, name: Name("nexus-b5e0f45a-5c7c-4d02-b3a0-86311690b334"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 70])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
90832024-12-20T22:24:14.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90842024-12-20T22:24:14.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90852024-12-20T22:24:14.078ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90862024-12-20T22:24:14.078ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7318bfac-453e-44b5-8ff4-b1f5afb84cef", "content-length": "2", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
90872024-12-20T22:24:14.078ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90882024-12-20T22:24:14.078ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c34dfd2f-e327-42ab-a6cd-618a90ee271b", "content-length": "52", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
90892024-12-20T22:24:14.078ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
90902024-12-20T22:24:14.078ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90912024-12-20T22:24:14.079ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90922024-12-20T22:24:14.081ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
90932024-12-20T22:24:14.081ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90942024-12-20T22:24:14.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90952024-12-20T22:24:14.084ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
90962024-12-20T22:24:14.084ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6294325a-a534-458e-bb4d-a82bd38fecc7, kind: Service { id: 57b826de-37e7-4730-9cdb-924c3900cca7 }, name: Name("external-dns-57b826de-37e7-4730-9cdb-924c3900cca7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ce073ed-6a64-4650-b03e-71f0f12930d7, kind: Service { id: 238017a4-2d19-43d3-aa35-92a1ed3e9c3a }, name: Name("external-dns-238017a4-2d19-43d3-aa35-92a1ed3e9c3a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3607a34f-6331-464f-877d-901d32157481, kind: Service { id: 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c }, name: Name("nexus-73e5bc12-d8f1-466a-967d-9d6c8ff45a8c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7a44818-9125-492c-bc37-8f9c5048ca11, kind: Service { id: bb5e4259-2e9e-45b9-9306-cce16be8e04b }, name: Name("nexus-bb5e4259-2e9e-45b9-9306-cce16be8e04b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b13610c9-f459-4f98-bff6-a9dc2fa99a8a, kind: Service { id: b5e0f45a-5c7c-4d02-b3a0-86311690b334 }, name: Name("nexus-b5e0f45a-5c7c-4d02-b3a0-86311690b334"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 70])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
90972024-12-20T22:24:14.084ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
90982024-12-20T22:24:14.107ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "79a5f4b5-57b9-49ad-9a57-bb2404381ae3", "date": "Fri, 20 Dec 2024 22:24:14 GMT"} })
90992024-12-20T22:24:14.109ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 665.664619ms iteration = 22 status = {}
91002024-12-20T22:24:14.203ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: a0a780c3-0806-4044-8e4b-e91bf0405221, time_created: 2024-12-20T22:14:47.895491Z, time_modified: 2024-12-20T22:14:47.895491Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
91012024-12-20T22:24:14.203ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
91022024-12-20T22:24:14.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91032024-12-20T22:24:14.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91042024-12-20T22:24:14.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91052024-12-20T22:24:14.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91062024-12-20T22:24:14.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91072024-12-20T22:24:14.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
91082024-12-20T22:24:14.248ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
91092024-12-20T22:24:14.250ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "d618c112-3c76-4543-9076-5880139f9b93", "date": "Fri, 20 Dec 2024 22:24:14 GMT"} })
91102024-12-20T22:24:14.252ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
91112024-12-20T22:24:14.252ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 808.176383ms
91122024-12-20T22:24:14.252ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 808.185774ms iteration = 3 status = {}
91132024-12-20T22:24:14.293ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "56aefa16-5be0-4e7c-b21b-7fe15cb7db94", "date": "Fri, 20 Dec 2024 22:24:14 GMT"} })
91142024-12-20T22:24:14.293ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
91152024-12-20T22:24:14.293ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91162024-12-20T22:24:14.294ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1659d61-c379-4b10-a9a7-3df4c40acb63", "content-length": "682", "date": "Fri, 20 Dec 2024 22:24:14 GMT"} })
91172024-12-20T22:24:14.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91182024-12-20T22:24:14.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91192024-12-20T22:24:14.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91202024-12-20T22:24:14.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91212024-12-20T22:24:14.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91222024-12-20T22:24:14.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91232024-12-20T22:24:14.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91242024-12-20T22:24:14.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91252024-12-20T22:24:14.311ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 867.172987ms iteration = 21 status = {}
91262024-12-20T22:24:14.473ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a1b0798-d96f-4bea-8334-1ff1bd7c2508", "content-length": "30797", "date": "Fri, 20 Dec 2024 22:24:13 GMT"} })
91272024-12-20T22:24:14.474ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
91282024-12-20T22:24:14.474ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
91292024-12-20T22:24:14.474ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
91302024-12-20T22:24:14.476ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
91312024-12-20T22:24:14.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
91322024-12-20T22:24:14.478ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91332024-12-20T22:24:14.480ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
91342024-12-20T22:24:14.480ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
91352024-12-20T22:24:14.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
91362024-12-20T22:24:14.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4be89ac3-7aa0-454b-911d-4d1885ba83ef roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91372024-12-20T22:24:14.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4be89ac3-7aa0-454b-911d-4d1885ba83ef resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91382024-12-20T22:24:14.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4be89ac3-7aa0-454b-911d-4d1885ba83ef response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91392024-12-20T22:24:14.666ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = c52c1e22-1256-4edd-be10-726ec6f9fc7b file = nexus/db-queries/src/db/datastore/inventory.rs:1010
91402024-12-20T22:24:14.666ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = c52c1e22-1256-4edd-be10-726ec6f9fc7b time_started = 2024-12-20 22:24:13.840254 UTC
91412024-12-20T22:24:14.666ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.222390542s iteration = 4 status = {"collection_id":"c52c1e22-1256-4edd-be10-726ec6f9fc7b","time_done":"2024-12-20 22:24:14.474832 UTC","time_started":"2024-12-20 22:24:13.840254 UTC"}
91422024-12-20T22:24:14.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
91432024-12-20T22:24:14.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91442024-12-20T22:24:14.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91452024-12-20T22:24:14.668ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91462024-12-20T22:24:14.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91472024-12-20T22:24:14.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91482024-12-20T22:24:14.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91492024-12-20T22:24:14.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91502024-12-20T22:24:14.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91512024-12-20T22:24:14.673ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91522024-12-20T22:24:14.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91532024-12-20T22:24:14.675ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91542024-12-20T22:24:14.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91552024-12-20T22:24:14.719ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 52.597849ms iteration = 25 status = {"physical_disks_added":0}
91562024-12-20T22:24:14.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f15a35ff-7082-4a45-895e-99dc1d2fca2d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
91572024-12-20T22:24:14.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f15a35ff-7082-4a45-895e-99dc1d2fca2d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
91582024-12-20T22:24:14.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f15a35ff-7082-4a45-895e-99dc1d2fca2d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
91592024-12-20T22:24:15.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 25437cea-d68f-4832-98ba-49654cede0b0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91602024-12-20T22:24:15.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 25437cea-d68f-4832-98ba-49654cede0b0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91612024-12-20T22:24:15.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 25437cea-d68f-4832-98ba-49654cede0b0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91622024-12-20T22:24:15.690ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1299 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 6d830c84-bb17-4dd5-b7d6-6720d1cfc271 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
91632024-12-20T22:24:16.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 299aa7cb-792f-4588-a190-2a9ae85fb97d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91642024-12-20T22:24:16.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 299aa7cb-792f-4588-a190-2a9ae85fb97d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91652024-12-20T22:24:16.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 299aa7cb-792f-4588-a190-2a9ae85fb97d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91662024-12-20T22:24:17.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eadbaa66-028a-409e-b99c-85d421cf87f3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91672024-12-20T22:24:17.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eadbaa66-028a-409e-b99c-85d421cf87f3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91682024-12-20T22:24:17.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eadbaa66-028a-409e-b99c-85d421cf87f3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91692024-12-20T22:24:17.749ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44978
91702024-12-20T22:24:17.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44978 req_id = 1f93e7dc-6d85-4acc-903e-3cdb92073f10 roles = RoleSet { roles: {} } uri = /metrics/producers
91712024-12-20T22:24:17.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44978 req_id = 1f93e7dc-6d85-4acc-903e-3cdb92073f10 resource = Database result = Ok(()) uri = /metrics/producers
91722024-12-20T22:24:17.764ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 03760c77-b0c3-42eb-a705-bfee77be2fbe
91732024-12-20T22:24:17.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14238 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44978 req_id = 1f93e7dc-6d85-4acc-903e-3cdb92073f10 response_code = 201 uri = /metrics/producers
91742024-12-20T22:24:18.328ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:56095
91752024-12-20T22:24:18.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56095 req_id = dca47a95-f014-462a-97ba-c23b17175f2e roles = RoleSet { roles: {} } uri = /metrics/producers
91762024-12-20T22:24:18.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56095 req_id = dca47a95-f014-462a-97ba-c23b17175f2e resource = Database result = Ok(()) uri = /metrics/producers
91772024-12-20T22:24:18.367ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = a0a780c3-0806-4044-8e4b-e91bf0405221
91782024-12-20T22:24:18.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39104 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56095 req_id = dca47a95-f014-462a-97ba-c23b17175f2e response_code = 201 uri = /metrics/producers
91792024-12-20T22:24:18.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cb76c6be-a03b-4590-8206-8dcd29bdd776 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91802024-12-20T22:24:18.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cb76c6be-a03b-4590-8206-8dcd29bdd776 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91812024-12-20T22:24:18.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cb76c6be-a03b-4590-8206-8dcd29bdd776 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91822024-12-20T22:24:18.959ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:59485
91832024-12-20T22:24:18.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59485 req_id = 2cce6e12-3fdd-4214-af11-6118037c5813 roles = RoleSet { roles: {} } uri = /metrics/producers
91842024-12-20T22:24:18.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59485 req_id = 2cce6e12-3fdd-4214-af11-6118037c5813 resource = Database result = Ok(()) uri = /metrics/producers
91852024-12-20T22:24:19.001ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 7f6e5691-338a-4d1e-8ab4-9564fc795162
91862024-12-20T22:24:19.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42099 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59485 req_id = 2cce6e12-3fdd-4214-af11-6118037c5813 response_code = 201 uri = /metrics/producers
91872024-12-20T22:24:19.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bc5f5638-3f65-4d7d-83e8-0084770ad2cb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91882024-12-20T22:24:19.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bc5f5638-3f65-4d7d-83e8-0084770ad2cb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91892024-12-20T22:24:19.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bc5f5638-3f65-4d7d-83e8-0084770ad2cb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91902024-12-20T22:24:20.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3e76e081-2a57-4219-91f9-c495bf8e2318 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91912024-12-20T22:24:20.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3e76e081-2a57-4219-91f9-c495bf8e2318 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91922024-12-20T22:24:20.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3e76e081-2a57-4219-91f9-c495bf8e2318 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91932024-12-20T22:24:21.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 31e10f51-854a-4f9e-9e4b-002ad33fe137 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91942024-12-20T22:24:21.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 31e10f51-854a-4f9e-9e4b-002ad33fe137 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91952024-12-20T22:24:21.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 31e10f51-854a-4f9e-9e4b-002ad33fe137 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91962024-12-20T22:24:22.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d17305b8-11aa-4b23-8dbc-ba6f04b5384b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91972024-12-20T22:24:22.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d17305b8-11aa-4b23-8dbc-ba6f04b5384b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91982024-12-20T22:24:22.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d17305b8-11aa-4b23-8dbc-ba6f04b5384b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
91992024-12-20T22:24:23.443ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
92002024-12-20T22:24:23.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
92012024-12-20T22:24:23.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92022024-12-20T22:24:23.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92032024-12-20T22:24:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92042024-12-20T22:24:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92052024-12-20T22:24:23.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92062024-12-20T22:24:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92072024-12-20T22:24:23.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92082024-12-20T22:24:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92092024-12-20T22:24:23.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92102024-12-20T22:24:23.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92112024-12-20T22:24:23.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92122024-12-20T22:24:23.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
92132024-12-20T22:24:23.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92142024-12-20T22:24:23.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92152024-12-20T22:24:23.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
92162024-12-20T22:24:23.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.338855ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
92172024-12-20T22:24:23.474ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92182024-12-20T22:24:23.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92192024-12-20T22:24:23.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.427598ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92202024-12-20T22:24:23.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2322471-7a00-4d6c-b196-6db754b38918 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92212024-12-20T22:24:23.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2322471-7a00-4d6c-b196-6db754b38918 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92222024-12-20T22:24:23.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2322471-7a00-4d6c-b196-6db754b38918 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92232024-12-20T22:24:24.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d4a51ebe-9a86-4f6a-974b-fff6e8932869 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92242024-12-20T22:24:24.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d4a51ebe-9a86-4f6a-974b-fff6e8932869 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92252024-12-20T22:24:24.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d4a51ebe-9a86-4f6a-974b-fff6e8932869 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92262024-12-20T22:24:25.690ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1328 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 7998a5b7-14e1-4ea7-9fb7-a880c7d3b0d0 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
92272024-12-20T22:24:25.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c8667f7e-a9dc-4b9a-accd-9ccc84763672 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92282024-12-20T22:24:25.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c8667f7e-a9dc-4b9a-accd-9ccc84763672 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92292024-12-20T22:24:25.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c8667f7e-a9dc-4b9a-accd-9ccc84763672 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92302024-12-20T22:24:26.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f07c79bb-7ced-47e1-88e1-d1c9532dc183 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92312024-12-20T22:24:26.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f07c79bb-7ced-47e1-88e1-d1c9532dc183 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92322024-12-20T22:24:26.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f07c79bb-7ced-47e1-88e1-d1c9532dc183 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92332024-12-20T22:24:27.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7b5f597a-b868-44ea-a25f-503790f8a2c5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92342024-12-20T22:24:27.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7b5f597a-b868-44ea-a25f-503790f8a2c5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92352024-12-20T22:24:27.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7b5f597a-b868-44ea-a25f-503790f8a2c5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92362024-12-20T22:24:28.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7f506539-4994-45b5-b24f-79f9c75399db roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92372024-12-20T22:24:28.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7f506539-4994-45b5-b24f-79f9c75399db resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92382024-12-20T22:24:28.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7f506539-4994-45b5-b24f-79f9c75399db response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92392024-12-20T22:24:29.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eb916856-5c6a-4f6e-b68d-98466b4e7e5a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92402024-12-20T22:24:29.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eb916856-5c6a-4f6e-b68d-98466b4e7e5a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92412024-12-20T22:24:29.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = eb916856-5c6a-4f6e-b68d-98466b4e7e5a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92422024-12-20T22:24:30.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 697e5c76-59ce-41a8-ac0a-8d446251abb5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92432024-12-20T22:24:30.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 697e5c76-59ce-41a8-ac0a-8d446251abb5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92442024-12-20T22:24:30.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 697e5c76-59ce-41a8-ac0a-8d446251abb5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92452024-12-20T22:24:31.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a3979e3c-1d73-424a-8955-e522694b84c3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92462024-12-20T22:24:31.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a3979e3c-1d73-424a-8955-e522694b84c3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92472024-12-20T22:24:31.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a3979e3c-1d73-424a-8955-e522694b84c3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92482024-12-20T22:24:32.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = abbbd620-954c-4e71-b360-e714358c938f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92492024-12-20T22:24:32.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = abbbd620-954c-4e71-b360-e714358c938f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92502024-12-20T22:24:32.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = abbbd620-954c-4e71-b360-e714358c938f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92512024-12-20T22:24:33.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
92522024-12-20T22:24:33.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92532024-12-20T22:24:33.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
92542024-12-20T22:24:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92552024-12-20T22:24:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92562024-12-20T22:24:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92572024-12-20T22:24:33.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92582024-12-20T22:24:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92592024-12-20T22:24:33.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92602024-12-20T22:24:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92612024-12-20T22:24:33.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92622024-12-20T22:24:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92632024-12-20T22:24:33.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92642024-12-20T22:24:33.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92652024-12-20T22:24:33.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92662024-12-20T22:24:33.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
92672024-12-20T22:24:33.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92682024-12-20T22:24:33.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92692024-12-20T22:24:33.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
92702024-12-20T22:24:33.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.984761ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
92712024-12-20T22:24:33.474ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.187873ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92722024-12-20T22:24:34.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d6908976-e54e-44ee-99c6-743ff94af1c8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92732024-12-20T22:24:34.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d6908976-e54e-44ee-99c6-743ff94af1c8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92742024-12-20T22:24:34.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1770 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d6908976-e54e-44ee-99c6-743ff94af1c8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92752024-12-20T22:24:35.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e3b70b7a-26e0-40eb-ab73-9e25e99840d4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92762024-12-20T22:24:35.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e3b70b7a-26e0-40eb-ab73-9e25e99840d4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92772024-12-20T22:24:35.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e3b70b7a-26e0-40eb-ab73-9e25e99840d4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92782024-12-20T22:24:35.690ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1497 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = fb7d5a2c-fa84-406b-912a-3dccf39fcdc6 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
92792024-12-20T22:24:36.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d951017d-67bd-4b5a-b222-695458e5d2fc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92802024-12-20T22:24:36.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d951017d-67bd-4b5a-b222-695458e5d2fc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92812024-12-20T22:24:36.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d951017d-67bd-4b5a-b222-695458e5d2fc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92822024-12-20T22:24:37.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f88e673c-6026-4755-a995-bf818026125e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92832024-12-20T22:24:37.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f88e673c-6026-4755-a995-bf818026125e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92842024-12-20T22:24:37.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f88e673c-6026-4755-a995-bf818026125e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92852024-12-20T22:24:38.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 41ffb531-8ddd-4def-bd61-6336ca48907d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92862024-12-20T22:24:38.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 41ffb531-8ddd-4def-bd61-6336ca48907d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92872024-12-20T22:24:38.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 41ffb531-8ddd-4def-bd61-6336ca48907d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92882024-12-20T22:24:39.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 58f2c797-6754-4d41-ba43-78678b14595a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92892024-12-20T22:24:39.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 58f2c797-6754-4d41-ba43-78678b14595a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92902024-12-20T22:24:39.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 58f2c797-6754-4d41-ba43-78678b14595a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92912024-12-20T22:24:40.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e326fd32-f6fd-4df1-99ac-20c528e0e2f2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92922024-12-20T22:24:40.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e326fd32-f6fd-4df1-99ac-20c528e0e2f2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92932024-12-20T22:24:40.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2686 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e326fd32-f6fd-4df1-99ac-20c528e0e2f2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
92942024-12-20T22:24:40.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 08050469-387f-45ef-860f-4a8c70b445f9 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
92952024-12-20T22:24:40.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 08050469-387f-45ef-860f-4a8c70b445f9 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
92962024-12-20T22:24:40.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 08050469-387f-45ef-860f-4a8c70b445f9 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
92972024-12-20T22:24:40.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 27069141-99e3-433d-93ef-842f810745c8 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
92982024-12-20T22:24:40.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 27069141-99e3-433d-93ef-842f810745c8 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
92992024-12-20T22:24:40.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 27069141-99e3-433d-93ef-842f810745c8 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
93002024-12-20T22:24:41.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1807097d-ca3a-47ca-a9b6-9100eb5df255 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
93012024-12-20T22:24:41.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1807097d-ca3a-47ca-a9b6-9100eb5df255 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
93022024-12-20T22:24:41.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1807097d-ca3a-47ca-a9b6-9100eb5df255 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
93032024-12-20T22:24:42.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4ecde995-3933-47f9-92eb-51460c9aa3c5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
93042024-12-20T22:24:42.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4ecde995-3933-47f9-92eb-51460c9aa3c5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
93052024-12-20T22:24:42.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4ecde995-3933-47f9-92eb-51460c9aa3c5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
93062024-12-20T22:24:43.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3a122e3c-748d-4294-b426-0aacf2f6715b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
93072024-12-20T22:24:43.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3a122e3c-748d-4294-b426-0aacf2f6715b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
93082024-12-20T22:24:43.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3a122e3c-748d-4294-b426-0aacf2f6715b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
93092024-12-20T22:24:43.443ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
93102024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
93112024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
93122024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93132024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93142024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
93152024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93162024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
93172024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
93182024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93192024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93202024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
93212024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
93222024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93232024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
93242024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
93252024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
93262024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93272024-12-20T22:24:43.444ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93282024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93292024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93302024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
93312024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
93322024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
93332024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93342024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
93352024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93362024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
93372024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
93382024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
93392024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93402024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
93412024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93422024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
93432024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
93442024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93452024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93462024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93472024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93482024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93492024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93502024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93512024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93522024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93532024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93542024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93552024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93562024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93572024-12-20T22:24:43.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93582024-12-20T22:24:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93592024-12-20T22:24:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93602024-12-20T22:24:43.448ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93612024-12-20T22:24:43.448ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93622024-12-20T22:24:43.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93632024-12-20T22:24:43.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93642024-12-20T22:24:43.448ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.456115ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93652024-12-20T22:24:43.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 374503189 } })
93662024-12-20T22:24:43.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
93672024-12-20T22:24:43.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93682024-12-20T22:24:43.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93692024-12-20T22:24:43.450ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93702024-12-20T22:24:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93712024-12-20T22:24:43.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93722024-12-20T22:24:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93732024-12-20T22:24:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93742024-12-20T22:24:43.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93752024-12-20T22:24:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93762024-12-20T22:24:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93772024-12-20T22:24:43.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93782024-12-20T22:24:43.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93792024-12-20T22:24:43.461ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 387285587 } })
93802024-12-20T22:24:43.461ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93812024-12-20T22:24:43.461ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93822024-12-20T22:24:43.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93832024-12-20T22:24:43.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93842024-12-20T22:24:43.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93852024-12-20T22:24:43.462ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93862024-12-20T22:24:43.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93872024-12-20T22:24:43.467ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93882024-12-20T22:24:43.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93892024-12-20T22:24:43.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93902024-12-20T22:24:43.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93912024-12-20T22:24:43.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93922024-12-20T22:24:43.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93932024-12-20T22:24:43.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.551439ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
93942024-12-20T22:24:43.499ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93952024-12-20T22:24:43.499ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93962024-12-20T22:24:43.500ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93972024-12-20T22:24:43.500ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0994adc-900f-497c-be29-5df436f1fa7d", "content-length": "26", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
93982024-12-20T22:24:43.500ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93992024-12-20T22:24:43.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94002024-12-20T22:24:43.500ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94012024-12-20T22:24:43.502ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94022024-12-20T22:24:43.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94032024-12-20T22:24:43.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
94042024-12-20T22:24:43.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94052024-12-20T22:24:43.505ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94062024-12-20T22:24:43.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94072024-12-20T22:24:43.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94082024-12-20T22:24:43.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
94092024-12-20T22:24:43.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.705691ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
94102024-12-20T22:24:43.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
94112024-12-20T22:24:43.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94122024-12-20T22:24:43.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94132024-12-20T22:24:43.508ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.933873ms iteration = 22 status = 0
94142024-12-20T22:24:43.509ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94152024-12-20T22:24:43.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94162024-12-20T22:24:43.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94172024-12-20T22:24:43.513ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94182024-12-20T22:24:43.513ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94192024-12-20T22:24:43.513ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94202024-12-20T22:24:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94212024-12-20T22:24:43.516ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94222024-12-20T22:24:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94232024-12-20T22:24:43.516ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94242024-12-20T22:24:43.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94252024-12-20T22:24:43.518ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94262024-12-20T22:24:43.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94272024-12-20T22:24:43.520ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94282024-12-20T22:24:43.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94292024-12-20T22:24:43.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94302024-12-20T22:24:43.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94312024-12-20T22:24:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94322024-12-20T22:24:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94332024-12-20T22:24:43.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94342024-12-20T22:24:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94352024-12-20T22:24:43.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94362024-12-20T22:24:43.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
94372024-12-20T22:24:43.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94382024-12-20T22:24:43.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94392024-12-20T22:24:43.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94402024-12-20T22:24:43.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94412024-12-20T22:24:43.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94422024-12-20T22:24:43.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94432024-12-20T22:24:43.528ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
94442024-12-20T22:24:43.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.797373ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
94452024-12-20T22:24:43.529ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 455029659 } })
94462024-12-20T22:24:43.529ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
94472024-12-20T22:24:43.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.315279ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94482024-12-20T22:24:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.822365ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94492024-12-20T22:24:43.547ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94502024-12-20T22:24:43.547ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94512024-12-20T22:24:43.547ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "936b0d6c-7c0c-4c1c-9a77-e325888c2e2a", "content-length": "26", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
94522024-12-20T22:24:43.547ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94532024-12-20T22:24:43.549ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94542024-12-20T22:24:43.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 106.598412ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94552024-12-20T22:24:43.552ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94562024-12-20T22:24:43.552ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94572024-12-20T22:24:43.552ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.370311ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94582024-12-20T22:24:43.569ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
94592024-12-20T22:24:43.569ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 125.535824ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
94602024-12-20T22:24:43.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.387272ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
94612024-12-20T22:24:43.578ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94622024-12-20T22:24:43.578ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "af98fe47-02ca-447c-a09a-32bd332df466", "content-length": "1", "date": "Fri, 20 Dec 2024 22:24:42 GMT"} })
94632024-12-20T22:24:43.579ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94642024-12-20T22:24:43.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94652024-12-20T22:24:43.582ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 138.172511ms iteration = 22 status = null
94662024-12-20T22:24:43.595ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
94672024-12-20T22:24:43.595ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94682024-12-20T22:24:43.595ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bce91a2-430a-466a-8a0c-06a60847e565", "content-length": "26", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
94692024-12-20T22:24:43.595ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94702024-12-20T22:24:43.597ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
94712024-12-20T22:24:43.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94722024-12-20T22:24:43.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94732024-12-20T22:24:43.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94742024-12-20T22:24:43.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94752024-12-20T22:24:43.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94762024-12-20T22:24:43.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94772024-12-20T22:24:43.603ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 159.483585ms iteration = 22 status = {}
94782024-12-20T22:24:43.613ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 169.344735ms iteration = 26 status = {"physical_disks_added":0}
94792024-12-20T22:24:43.657ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94802024-12-20T22:24:43.657ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94812024-12-20T22:24:43.657ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5827b011-76db-4e65-81e0-5fa6365c908d", "content-length": "372", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
94822024-12-20T22:24:43.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94832024-12-20T22:24:43.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94842024-12-20T22:24:43.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94852024-12-20T22:24:43.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94862024-12-20T22:24:43.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94872024-12-20T22:24:43.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94882024-12-20T22:24:43.704ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94892024-12-20T22:24:43.704ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94902024-12-20T22:24:43.704ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2ce79632-0105-49b0-8cf5-55d6967b9a85", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
94912024-12-20T22:24:43.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94922024-12-20T22:24:43.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94932024-12-20T22:24:43.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94942024-12-20T22:24:43.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94952024-12-20T22:24:43.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94962024-12-20T22:24:43.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94972024-12-20T22:24:43.724ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94982024-12-20T22:24:43.724ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dddca694-e7e3-4e14-a329-73304f21d7fc", "content-length": "691", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
94992024-12-20T22:24:43.724ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
95002024-12-20T22:24:43.724ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
95012024-12-20T22:24:43.724ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
95022024-12-20T22:24:43.725ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 281.686364ms iteration = 22 status = {}
95032024-12-20T22:24:43.727ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95042024-12-20T22:24:43.727ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95052024-12-20T22:24:43.727ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e7672bb3-9f46-4c27-8016-adb937840dc4", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
95062024-12-20T22:24:43.729ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.523593ms iteration = 23 status = {}
95072024-12-20T22:24:43.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95082024-12-20T22:24:43.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95092024-12-20T22:24:43.751ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
95102024-12-20T22:24:43.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95112024-12-20T22:24:43.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95122024-12-20T22:24:43.764ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95132024-12-20T22:24:43.764ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c296cbf-332a-4856-b3ea-50ecd17202da", "content-length": "134", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
95142024-12-20T22:24:43.764ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95152024-12-20T22:24:43.764ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
95162024-12-20T22:24:43.765ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95172024-12-20T22:24:43.765ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95182024-12-20T22:24:43.765ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95192024-12-20T22:24:43.765ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95202024-12-20T22:24:43.765ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95212024-12-20T22:24:43.765ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95222024-12-20T22:24:43.765ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95232024-12-20T22:24:43.765ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95242024-12-20T22:24:43.765ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
95252024-12-20T22:24:43.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95262024-12-20T22:24:43.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95272024-12-20T22:24:43.768ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
95282024-12-20T22:24:43.768ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bd5c1df-5c3d-4bb9-b7ca-39460f3bbd6f", "content-length": "2", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
95292024-12-20T22:24:43.768ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
95302024-12-20T22:24:43.768ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce97c23b-e855-41ea-a43d-b3c7e1d586df", "content-length": "52", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
95312024-12-20T22:24:43.768ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
95322024-12-20T22:24:43.768ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95332024-12-20T22:24:43.868ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3a42b68d-147b-412a-85ed-ba522fd7baa0", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
95342024-12-20T22:24:43.868ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
95352024-12-20T22:24:43.868ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95362024-12-20T22:24:43.869ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d01393d5-f35f-448c-8d4e-0f51726859f1", "content-length": "682", "date": "Fri, 20 Dec 2024 22:24:43 GMT"} })
95372024-12-20T22:24:43.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95382024-12-20T22:24:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95392024-12-20T22:24:43.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95402024-12-20T22:24:43.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95412024-12-20T22:24:43.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95422024-12-20T22:24:43.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95432024-12-20T22:24:43.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95442024-12-20T22:24:43.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95452024-12-20T22:24:43.887ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 443.666905ms iteration = 22 status = {}
95462024-12-20T22:24:44.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 338ffe4d-d424-4d89-bfbc-0f892b792e26 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95472024-12-20T22:24:44.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 338ffe4d-d424-4d89-bfbc-0f892b792e26 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95482024-12-20T22:24:44.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 338ffe4d-d424-4d89-bfbc-0f892b792e26 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95492024-12-20T22:24:44.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = a645fd52-fd60-4467-aa60-7f418ea80618 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
95502024-12-20T22:24:44.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = a645fd52-fd60-4467-aa60-7f418ea80618 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
95512024-12-20T22:24:44.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = a645fd52-fd60-4467-aa60-7f418ea80618 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
95522024-12-20T22:24:45.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 37acbbf3-dc29-43c8-9d47-d36263f12ffc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95532024-12-20T22:24:45.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 37acbbf3-dc29-43c8-9d47-d36263f12ffc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95542024-12-20T22:24:45.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 37acbbf3-dc29-43c8-9d47-d36263f12ffc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95552024-12-20T22:24:45.690ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = e656828d-84c5-4c57-a05d-4c322d6f6e62 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
95562024-12-20T22:24:46.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 52ed2a42-badc-4c4d-9199-d34b6790a618 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95572024-12-20T22:24:46.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 52ed2a42-badc-4c4d-9199-d34b6790a618 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95582024-12-20T22:24:46.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 52ed2a42-badc-4c4d-9199-d34b6790a618 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95592024-12-20T22:24:47.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b329a713-70d4-47bb-81aa-f0ca0cfd2ed5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95602024-12-20T22:24:47.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b329a713-70d4-47bb-81aa-f0ca0cfd2ed5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95612024-12-20T22:24:47.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b329a713-70d4-47bb-81aa-f0ca0cfd2ed5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95622024-12-20T22:24:48.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa77dcbc-6542-4a24-9a7b-1266cd257939 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95632024-12-20T22:24:48.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa77dcbc-6542-4a24-9a7b-1266cd257939 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95642024-12-20T22:24:48.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa77dcbc-6542-4a24-9a7b-1266cd257939 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95652024-12-20T22:24:49.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 201393f8-0d55-4b94-8396-7173b1bdbb48 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95662024-12-20T22:24:49.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 201393f8-0d55-4b94-8396-7173b1bdbb48 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95672024-12-20T22:24:49.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 201393f8-0d55-4b94-8396-7173b1bdbb48 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95682024-12-20T22:24:49.443ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
95692024-12-20T22:24:49.443ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
95702024-12-20T22:24:49.475ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
95712024-12-20T22:24:49.475ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:61665
95722024-12-20T22:24:49.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61665 req_id = 6d6d8b76-712e-48b8-b303-819eee7764c2 roles = RoleSet { roles: {} } uri = /metrics/producers
95732024-12-20T22:24:49.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61665 req_id = 6d6d8b76-712e-48b8-b303-819eee7764c2 resource = Database result = Ok(()) uri = /metrics/producers
95742024-12-20T22:24:49.488ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
95752024-12-20T22:24:49.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12656 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61665 req_id = 6d6d8b76-712e-48b8-b303-819eee7764c2 response_code = 201 uri = /metrics/producers
95762024-12-20T22:24:49.488ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "6d6d8b76-712e-48b8-b303-819eee7764c2", "content-length": "41", "date": "Fri, 20 Dec 2024 22:24:49 GMT"} })
95772024-12-20T22:24:49.488ZDEBGnexus (producer-registration-task): registered with nexus successfully
95782024-12-20T22:24:49.488ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
95792024-12-20T22:24:50.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 682d299c-490f-4b90-8cab-f02566541fa0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95802024-12-20T22:24:50.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 682d299c-490f-4b90-8cab-f02566541fa0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95812024-12-20T22:24:50.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 682d299c-490f-4b90-8cab-f02566541fa0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95822024-12-20T22:24:51.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 113d3e13-0742-4450-b0f8-cc1b8a64c6eb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95832024-12-20T22:24:51.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 113d3e13-0742-4450-b0f8-cc1b8a64c6eb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95842024-12-20T22:24:51.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 113d3e13-0742-4450-b0f8-cc1b8a64c6eb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95852024-12-20T22:24:52.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 27a97a9f-857b-4917-8fb8-4fca3ec8ca17 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95862024-12-20T22:24:52.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 27a97a9f-857b-4917-8fb8-4fca3ec8ca17 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95872024-12-20T22:24:52.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 27a97a9f-857b-4917-8fb8-4fca3ec8ca17 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95882024-12-20T22:24:53.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b505c8d3-13e3-44d5-b914-91967cb9eef3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95892024-12-20T22:24:53.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b505c8d3-13e3-44d5-b914-91967cb9eef3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95902024-12-20T22:24:53.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b505c8d3-13e3-44d5-b914-91967cb9eef3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
95912024-12-20T22:24:53.443ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
95922024-12-20T22:24:53.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
95932024-12-20T22:24:53.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95942024-12-20T22:24:53.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95952024-12-20T22:24:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95962024-12-20T22:24:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95972024-12-20T22:24:53.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95982024-12-20T22:24:53.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95992024-12-20T22:24:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96002024-12-20T22:24:53.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.285033ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96012024-12-20T22:24:53.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96022024-12-20T22:24:53.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96032024-12-20T22:24:53.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96042024-12-20T22:24:53.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96052024-12-20T22:24:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96062024-12-20T22:24:53.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96072024-12-20T22:24:53.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
96082024-12-20T22:24:53.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96092024-12-20T22:24:53.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96102024-12-20T22:24:53.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
96112024-12-20T22:24:53.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.318505ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
96122024-12-20T22:24:54.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93ed87cd-1979-4849-ab02-7afccc762bd0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96132024-12-20T22:24:54.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93ed87cd-1979-4849-ab02-7afccc762bd0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96142024-12-20T22:24:54.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 93ed87cd-1979-4849-ab02-7afccc762bd0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96152024-12-20T22:24:55.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 432b27c1-d35f-4a7c-bee0-de78c8aeba21 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96162024-12-20T22:24:55.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 432b27c1-d35f-4a7c-bee0-de78c8aeba21 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96172024-12-20T22:24:55.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 432b27c1-d35f-4a7c-bee0-de78c8aeba21 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96182024-12-20T22:24:55.690ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1412 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 4dfdfc17-7054-42ed-a09c-bad9d476489c response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
96192024-12-20T22:24:56.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5ff01ee2-6087-4429-9cab-95d7153e61bf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96202024-12-20T22:24:56.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5ff01ee2-6087-4429-9cab-95d7153e61bf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96212024-12-20T22:24:56.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5ff01ee2-6087-4429-9cab-95d7153e61bf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96222024-12-20T22:24:57.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cbc312d5-3168-41b9-999e-0f644fd47217 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96232024-12-20T22:24:57.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cbc312d5-3168-41b9-999e-0f644fd47217 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96242024-12-20T22:24:57.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cbc312d5-3168-41b9-999e-0f644fd47217 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96252024-12-20T22:24:58.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 76158ffd-c6dd-45e6-b193-31768f5c0f67 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96262024-12-20T22:24:58.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 76158ffd-c6dd-45e6-b193-31768f5c0f67 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96272024-12-20T22:24:58.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 76158ffd-c6dd-45e6-b193-31768f5c0f67 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96282024-12-20T22:24:59.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4567c0f5-cc7a-40da-80e5-45f9f0860117 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96292024-12-20T22:24:59.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4567c0f5-cc7a-40da-80e5-45f9f0860117 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96302024-12-20T22:24:59.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4567c0f5-cc7a-40da-80e5-45f9f0860117 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96312024-12-20T22:25:00.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b2ed8683-663e-4c6b-9274-f04e4e73a991 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96322024-12-20T22:25:00.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b2ed8683-663e-4c6b-9274-f04e4e73a991 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96332024-12-20T22:25:00.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b2ed8683-663e-4c6b-9274-f04e4e73a991 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96342024-12-20T22:25:01.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 587f29f1-22c2-484f-b2cb-a8201930a4ae roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96352024-12-20T22:25:01.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 587f29f1-22c2-484f-b2cb-a8201930a4ae resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96362024-12-20T22:25:01.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 587f29f1-22c2-484f-b2cb-a8201930a4ae response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96372024-12-20T22:25:02.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a8184ea4-e6dd-4c4e-8e11-515b2958605e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96382024-12-20T22:25:02.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a8184ea4-e6dd-4c4e-8e11-515b2958605e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96392024-12-20T22:25:02.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a8184ea4-e6dd-4c4e-8e11-515b2958605e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96402024-12-20T22:25:03.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
96412024-12-20T22:25:03.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
96422024-12-20T22:25:03.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96432024-12-20T22:25:03.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96442024-12-20T22:25:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96452024-12-20T22:25:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96462024-12-20T22:25:03.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96472024-12-20T22:25:03.447ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96482024-12-20T22:25:03.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96492024-12-20T22:25:03.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.410405ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96502024-12-20T22:25:03.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96512024-12-20T22:25:03.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96522024-12-20T22:25:03.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96532024-12-20T22:25:03.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96542024-12-20T22:25:03.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96552024-12-20T22:25:03.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96562024-12-20T22:25:03.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
96572024-12-20T22:25:03.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96582024-12-20T22:25:03.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96592024-12-20T22:25:03.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
96602024-12-20T22:25:03.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.977501ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
96612024-12-20T22:25:03.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63c38a05-2a7d-4774-b14c-1a50d2a51c17 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96622024-12-20T22:25:03.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63c38a05-2a7d-4774-b14c-1a50d2a51c17 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96632024-12-20T22:25:03.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63c38a05-2a7d-4774-b14c-1a50d2a51c17 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96642024-12-20T22:25:04.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f9a95205-85fc-404c-a41a-ec0ab6985b75 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96652024-12-20T22:25:04.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f9a95205-85fc-404c-a41a-ec0ab6985b75 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96662024-12-20T22:25:04.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f9a95205-85fc-404c-a41a-ec0ab6985b75 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96672024-12-20T22:25:05.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 89912bc4-f8cc-46df-bf2c-2e2ce129da7d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96682024-12-20T22:25:05.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 89912bc4-f8cc-46df-bf2c-2e2ce129da7d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96692024-12-20T22:25:05.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 89912bc4-f8cc-46df-bf2c-2e2ce129da7d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96702024-12-20T22:25:05.690ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1375 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 2ca8f486-2931-47bd-88b5-b4d50e997bc9 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
96712024-12-20T22:25:06.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2b63c8a8-7503-42bf-9c3f-c8c8e4d94ade roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96722024-12-20T22:25:06.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2b63c8a8-7503-42bf-9c3f-c8c8e4d94ade resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96732024-12-20T22:25:06.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2b63c8a8-7503-42bf-9c3f-c8c8e4d94ade response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96742024-12-20T22:25:07.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d9f9839c-18b2-4713-98df-0e79479ad64b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96752024-12-20T22:25:07.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d9f9839c-18b2-4713-98df-0e79479ad64b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96762024-12-20T22:25:07.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d9f9839c-18b2-4713-98df-0e79479ad64b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96772024-12-20T22:25:08.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2c4b10b-f8ed-4b48-9b4a-d0dc124a54ae roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96782024-12-20T22:25:08.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2c4b10b-f8ed-4b48-9b4a-d0dc124a54ae resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96792024-12-20T22:25:08.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2c4b10b-f8ed-4b48-9b4a-d0dc124a54ae response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96802024-12-20T22:25:09.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8a9a9aad-3198-495f-8132-51f0dc4fa6c5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96812024-12-20T22:25:09.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8a9a9aad-3198-495f-8132-51f0dc4fa6c5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96822024-12-20T22:25:09.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8a9a9aad-3198-495f-8132-51f0dc4fa6c5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96832024-12-20T22:25:10.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 928de5d0-12a3-4e2f-9f2d-f4f572c46dfa roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96842024-12-20T22:25:10.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 928de5d0-12a3-4e2f-9f2d-f4f572c46dfa resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96852024-12-20T22:25:10.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 928de5d0-12a3-4e2f-9f2d-f4f572c46dfa response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96862024-12-20T22:25:11.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 28ef19de-3b43-496d-ba58-e062bb039952 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96872024-12-20T22:25:11.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 28ef19de-3b43-496d-ba58-e062bb039952 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96882024-12-20T22:25:11.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 28ef19de-3b43-496d-ba58-e062bb039952 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96892024-12-20T22:25:12.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 26307b32-2e4f-465e-97d4-9241a6bda2dd roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96902024-12-20T22:25:12.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 26307b32-2e4f-465e-97d4-9241a6bda2dd resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96912024-12-20T22:25:12.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 26307b32-2e4f-465e-97d4-9241a6bda2dd response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
96922024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
96932024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
96942024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96952024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96962024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
96972024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
96982024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96992024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
97002024-12-20T22:25:13.444ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
97012024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
97022024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97032024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97042024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
97052024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
97062024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
97072024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
97082024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97092024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
97102024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
97112024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97122024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
97132024-12-20T22:25:13.444ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97142024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97152024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97162024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
97172024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
97182024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97192024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
97202024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
97212024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
97222024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97232024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
97242024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97252024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
97262024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97272024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
97282024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
97292024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97302024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
97312024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97322024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
97332024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
97342024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97352024-12-20T22:25:13.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
97362024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
97372024-12-20T22:25:13.445ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
97382024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
97392024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97402024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.13\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
97412024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
97422024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
97432024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97442024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97452024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97462024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
97472024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
97482024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
97492024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97502024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97512024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
97522024-12-20T22:25:13.445ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:15:13.444980711 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
97532024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
97542024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97552024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97562024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97572024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97582024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97592024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
97602024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97612024-12-20T22:25:13.445ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 371076874 } })
97622024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97632024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97642024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97652024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97662024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97672024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97682024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97692024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97702024-12-20T22:25:13.445ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 371276286 } })
97712024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97722024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97732024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97742024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97752024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97762024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97772024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
97782024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97792024-12-20T22:25:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97802024-12-20T22:25:13.446ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
97812024-12-20T22:25:13.446ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.518066ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
97822024-12-20T22:25:13.446ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
97832024-12-20T22:25:13.446ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.888169ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
97842024-12-20T22:25:13.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97852024-12-20T22:25:13.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97862024-12-20T22:25:13.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97872024-12-20T22:25:13.449ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.614957ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97882024-12-20T22:25:13.449ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97892024-12-20T22:25:13.449ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.577706ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
97902024-12-20T22:25:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97912024-12-20T22:25:13.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97922024-12-20T22:25:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97932024-12-20T22:25:13.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97942024-12-20T22:25:13.452ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97952024-12-20T22:25:13.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97962024-12-20T22:25:13.453ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97972024-12-20T22:25:13.453ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97982024-12-20T22:25:13.453ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.773508ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97992024-12-20T22:25:13.453ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 379197626 } })
98002024-12-20T22:25:13.453ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
98012024-12-20T22:25:13.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98022024-12-20T22:25:13.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98032024-12-20T22:25:13.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 380957643 } })
98042024-12-20T22:25:13.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.661387ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
98052024-12-20T22:25:13.455ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
98062024-12-20T22:25:13.456ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98072024-12-20T22:25:13.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98082024-12-20T22:25:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98092024-12-20T22:25:13.456ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98102024-12-20T22:25:13.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98112024-12-20T22:25:13.458ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98122024-12-20T22:25:13.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98132024-12-20T22:25:13.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98142024-12-20T22:25:13.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98152024-12-20T22:25:13.460ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98162024-12-20T22:25:13.460ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98172024-12-20T22:25:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98182024-12-20T22:25:13.460ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98192024-12-20T22:25:13.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98202024-12-20T22:25:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98212024-12-20T22:25:13.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
98222024-12-20T22:25:13.461ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
98232024-12-20T22:25:13.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
98242024-12-20T22:25:13.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98252024-12-20T22:25:13.463ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:15:13.444980711 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
98262024-12-20T22:25:13.463ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.281094ms iteration = 12 status = {"expiration":"2024-12-20T22:15:13.444980711Z","pruned":[]}
98272024-12-20T22:25:13.465ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98282024-12-20T22:25:13.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98292024-12-20T22:25:13.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98302024-12-20T22:25:13.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98312024-12-20T22:25:13.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98322024-12-20T22:25:13.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98332024-12-20T22:25:13.467ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98342024-12-20T22:25:13.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98352024-12-20T22:25:13.469ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98362024-12-20T22:25:13.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98372024-12-20T22:25:13.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98382024-12-20T22:25:13.479ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98392024-12-20T22:25:13.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98402024-12-20T22:25:13.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98412024-12-20T22:25:13.485ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98422024-12-20T22:25:13.485ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98432024-12-20T22:25:13.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98442024-12-20T22:25:13.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98452024-12-20T22:25:13.486ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98462024-12-20T22:25:13.486ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98472024-12-20T22:25:13.486ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98482024-12-20T22:25:13.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98492024-12-20T22:25:13.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98502024-12-20T22:25:13.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98512024-12-20T22:25:13.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98522024-12-20T22:25:13.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98532024-12-20T22:25:13.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98542024-12-20T22:25:13.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98552024-12-20T22:25:13.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98562024-12-20T22:25:13.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98572024-12-20T22:25:13.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98582024-12-20T22:25:13.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98592024-12-20T22:25:13.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98602024-12-20T22:25:13.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
98612024-12-20T22:25:13.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98622024-12-20T22:25:13.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98632024-12-20T22:25:13.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98642024-12-20T22:25:13.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
98652024-12-20T22:25:13.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98662024-12-20T22:25:13.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98672024-12-20T22:25:13.520ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 445911457 } })
98682024-12-20T22:25:13.520ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
98692024-12-20T22:25:13.521ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98702024-12-20T22:25:13.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.847803ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
98712024-12-20T22:25:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98722024-12-20T22:25:13.524ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98732024-12-20T22:25:13.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98742024-12-20T22:25:13.526ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
98752024-12-20T22:25:13.526ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.295348ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
98762024-12-20T22:25:13.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98772024-12-20T22:25:13.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98782024-12-20T22:25:13.528ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98792024-12-20T22:25:13.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98802024-12-20T22:25:13.529ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98812024-12-20T22:25:13.529ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
98822024-12-20T22:25:13.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98832024-12-20T22:25:13.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98842024-12-20T22:25:13.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98852024-12-20T22:25:13.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98862024-12-20T22:25:13.535ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98872024-12-20T22:25:13.535ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98882024-12-20T22:25:13.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98892024-12-20T22:25:13.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98902024-12-20T22:25:13.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98912024-12-20T22:25:13.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98922024-12-20T22:25:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98932024-12-20T22:25:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.983536ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98942024-12-20T22:25:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
98952024-12-20T22:25:13.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98962024-12-20T22:25:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98972024-12-20T22:25:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.266729ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98982024-12-20T22:25:13.543ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
98992024-12-20T22:25:13.543ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
99002024-12-20T22:25:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 99.277119ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
99012024-12-20T22:25:13.543ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
99022024-12-20T22:25:13.543ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
99032024-12-20T22:25:13.543ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
99042024-12-20T22:25:13.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99052024-12-20T22:25:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99062024-12-20T22:25:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.715004ms iteration = 23 status = 0
99072024-12-20T22:25:13.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99082024-12-20T22:25:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99092024-12-20T22:25:13.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99102024-12-20T22:25:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99112024-12-20T22:25:13.555ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99122024-12-20T22:25:13.558ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
99132024-12-20T22:25:13.558ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
99142024-12-20T22:25:13.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99152024-12-20T22:25:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99162024-12-20T22:25:13.559ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
99172024-12-20T22:25:13.559ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
99182024-12-20T22:25:13.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99192024-12-20T22:25:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99202024-12-20T22:25:13.559ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
99212024-12-20T22:25:13.559ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.154459ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
99222024-12-20T22:25:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
99232024-12-20T22:25:13.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99242024-12-20T22:25:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99252024-12-20T22:25:13.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99262024-12-20T22:25:13.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99272024-12-20T22:25:13.561ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99282024-12-20T22:25:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99292024-12-20T22:25:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99302024-12-20T22:25:13.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99312024-12-20T22:25:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99322024-12-20T22:25:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99332024-12-20T22:25:13.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99342024-12-20T22:25:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99352024-12-20T22:25:13.569ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
99362024-12-20T22:25:13.569ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
99372024-12-20T22:25:13.569ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
99382024-12-20T22:25:13.569ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 124.587724ms iteration = 13 status = {"generation":2}
99392024-12-20T22:25:13.570ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
99402024-12-20T22:25:13.570ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
99412024-12-20T22:25:13.570ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
99422024-12-20T22:25:13.570ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 125.828196ms iteration = 13 status = {"generation":1}
99432024-12-20T22:25:13.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
99442024-12-20T22:25:13.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
99452024-12-20T22:25:13.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.271171ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
99462024-12-20T22:25:13.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99472024-12-20T22:25:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99482024-12-20T22:25:13.589ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99492024-12-20T22:25:13.589ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
99502024-12-20T22:25:13.589ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.674446ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
99512024-12-20T22:25:13.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 152.0191ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
99522024-12-20T22:25:13.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99532024-12-20T22:25:13.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
99542024-12-20T22:25:13.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99552024-12-20T22:25:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99562024-12-20T22:25:13.626ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99572024-12-20T22:25:13.626ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
99582024-12-20T22:25:13.626ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99592024-12-20T22:25:13.626ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
99602024-12-20T22:25:13.626ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99612024-12-20T22:25:13.627ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4aac9a83-186e-4f09-9ebc-2962928d0b16", "content-length": "26", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} })
99622024-12-20T22:25:13.627ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99632024-12-20T22:25:13.627ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f0409fe-2669-40c0-993c-456bfb06346e", "content-length": "26", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} })
99642024-12-20T22:25:13.627ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99652024-12-20T22:25:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99662024-12-20T22:25:13.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99672024-12-20T22:25:13.631ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99682024-12-20T22:25:13.631ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99692024-12-20T22:25:13.631ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 186.421676ms iteration = 27 status = {"physical_disks_added":0}
99702024-12-20T22:25:13.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99712024-12-20T22:25:13.631ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99722024-12-20T22:25:13.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99732024-12-20T22:25:13.647ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
99742024-12-20T22:25:13.647ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 202.856791ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
99752024-12-20T22:25:13.672ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
99762024-12-20T22:25:13.672ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99772024-12-20T22:25:13.673ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c124a7d-d060-445e-8689-9db5e298d935", "content-length": "26", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} })
99782024-12-20T22:25:13.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99792024-12-20T22:25:13.674ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
99802024-12-20T22:25:13.676ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
99812024-12-20T22:25:13.676ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 231.786433ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
99822024-12-20T22:25:13.713ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
99832024-12-20T22:25:13.753ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
99842024-12-20T22:25:13.840ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99852024-12-20T22:25:13.841ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e566e6e-9861-473c-965a-471764eac46f", "content-length": "1", "date": "Fri, 20 Dec 2024 22:25:12 GMT"} })
99862024-12-20T22:25:13.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99872024-12-20T22:25:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99882024-12-20T22:25:13.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a38e293f-5c2c-4be4-9b5a-bdcc60540a95 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
99892024-12-20T22:25:13.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a38e293f-5c2c-4be4-9b5a-bdcc60540a95 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
99902024-12-20T22:25:13.883ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99912024-12-20T22:25:13.883ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99922024-12-20T22:25:13.883ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bc2b427-54ba-4d26-bf4d-a32e318bfa20", "content-length": "372", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} })
99932024-12-20T22:25:13.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99942024-12-20T22:25:13.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99952024-12-20T22:25:13.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99962024-12-20T22:25:13.885ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 441.309122ms iteration = 23 status = null
99972024-12-20T22:25:13.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a38e293f-5c2c-4be4-9b5a-bdcc60540a95 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
99982024-12-20T22:25:13.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99992024-12-20T22:25:13.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100002024-12-20T22:25:13.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100012024-12-20T22:25:13.899ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
100022024-12-20T22:25:13.899ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
100032024-12-20T22:25:13.899ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9c057a88-71d2-44e1-b752-02c9e32894d0", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} })
100042024-12-20T22:25:13.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100052024-12-20T22:25:13.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100062024-12-20T22:25:13.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100072024-12-20T22:25:13.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100082024-12-20T22:25:13.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100092024-12-20T22:25:13.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100102024-12-20T22:25:13.907ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
100112024-12-20T22:25:13.907ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
100122024-12-20T22:25:13.907ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0832fa22-6e21-4b23-9cd7-c3f0a2a1c196", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} })
100132024-12-20T22:25:13.909ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 464.930759ms iteration = 24 status = {}
100142024-12-20T22:25:13.924ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 480.205053ms iteration = 23 status = {}
100152024-12-20T22:25:14.013ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
100162024-12-20T22:25:14.020ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
100172024-12-20T22:25:14.020ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
100182024-12-20T22:25:14.020ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d0568df9-4b67-460d-bac0-731d2b7e113d", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
100192024-12-20T22:25:14.020ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
100202024-12-20T22:25:14.022ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e1bad360-4f14-4c0a-aaa7-baf214d966b9", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
100212024-12-20T22:25:14.022ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
100222024-12-20T22:25:14.024ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
100232024-12-20T22:25:14.024ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 579.798726ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
100242024-12-20T22:25:14.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100252024-12-20T22:25:14.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100262024-12-20T22:25:14.069ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
100272024-12-20T22:25:14.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100282024-12-20T22:25:14.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100292024-12-20T22:25:14.070ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
100302024-12-20T22:25:14.071ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1ec5afb3-2d35-4c91-be6e-9117c0890c7b", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100312024-12-20T22:25:14.071ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100322024-12-20T22:25:14.073ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "be511fbf-6ce0-47a0-b918-d191b88fa5f3", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100332024-12-20T22:25:14.073ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100342024-12-20T22:25:14.077ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd67d301-b245-42b1-a7ce-4c566e00eb96", "content-length": "691", "date": "Fri, 20 Dec 2024 22:25:14 GMT"} })
100352024-12-20T22:25:14.077ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
100362024-12-20T22:25:14.077ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
100372024-12-20T22:25:14.077ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
100382024-12-20T22:25:14.077ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8508698b-6198-493b-8014-9db8a4be5dae", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100392024-12-20T22:25:14.077ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100402024-12-20T22:25:14.079ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100412024-12-20T22:25:14.079ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 634.544466ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
100422024-12-20T22:25:14.079ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 635.188672ms iteration = 23 status = {}
100432024-12-20T22:25:14.083ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
100442024-12-20T22:25:14.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9a0dbf4-4063-45d4-8820-589063d9037f", "content-length": "134", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} })
100452024-12-20T22:25:14.084ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
100462024-12-20T22:25:14.084ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
100472024-12-20T22:25:14.084ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
100482024-12-20T22:25:14.084ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
100492024-12-20T22:25:14.084ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100502024-12-20T22:25:14.084ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100512024-12-20T22:25:14.084ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100522024-12-20T22:25:14.084ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100532024-12-20T22:25:14.084ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100542024-12-20T22:25:14.084ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100552024-12-20T22:25:14.085ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
100562024-12-20T22:25:14.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100572024-12-20T22:25:14.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100582024-12-20T22:25:14.088ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
100592024-12-20T22:25:14.088ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "211ecea3-2814-4405-a844-601dcb72a905", "content-length": "2", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} })
100602024-12-20T22:25:14.088ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
100612024-12-20T22:25:14.088ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ba3e849-ed17-443b-bd78-1fd3676ef1b7", "content-length": "52", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} })
100622024-12-20T22:25:14.088ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
100632024-12-20T22:25:14.088ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
100642024-12-20T22:25:14.192ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4774f287-c71c-46c3-b666-dc82f11fbd0d", "date": "Fri, 20 Dec 2024 22:25:14 GMT"} })
100652024-12-20T22:25:14.192ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
100662024-12-20T22:25:14.192ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
100672024-12-20T22:25:14.192ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9b34f03-6421-4262-9afa-ea62b9e5de6a", "content-length": "682", "date": "Fri, 20 Dec 2024 22:25:13 GMT"} })
100682024-12-20T22:25:14.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100692024-12-20T22:25:14.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100702024-12-20T22:25:14.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100712024-12-20T22:25:14.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100722024-12-20T22:25:14.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100732024-12-20T22:25:14.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100742024-12-20T22:25:14.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100752024-12-20T22:25:14.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100762024-12-20T22:25:14.211ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 767.152421ms iteration = 23 status = {}
100772024-12-20T22:25:14.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6cf2d7c5-9540-4fc0-a0bb-45a011cfc5a0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100782024-12-20T22:25:14.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6cf2d7c5-9540-4fc0-a0bb-45a011cfc5a0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100792024-12-20T22:25:14.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6cf2d7c5-9540-4fc0-a0bb-45a011cfc5a0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100802024-12-20T22:25:15.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 6c4d8870-caa3-43d6-990c-29dba5aea31c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
100812024-12-20T22:25:15.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 6c4d8870-caa3-43d6-990c-29dba5aea31c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
100822024-12-20T22:25:15.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 6c4d8870-caa3-43d6-990c-29dba5aea31c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
100832024-12-20T22:25:15.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1501 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 5662e191-d875-458b-aa34-6ad012fbba1f response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
100842024-12-20T22:25:15.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1ec77a72-b1e8-4a4c-a165-b24af7344036 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100852024-12-20T22:25:15.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1ec77a72-b1e8-4a4c-a165-b24af7344036 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100862024-12-20T22:25:15.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1ec77a72-b1e8-4a4c-a165-b24af7344036 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100872024-12-20T22:25:16.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6e6610b-a2bd-465a-abc4-2e7adeb3d7fa roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100882024-12-20T22:25:16.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6e6610b-a2bd-465a-abc4-2e7adeb3d7fa resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100892024-12-20T22:25:16.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c6e6610b-a2bd-465a-abc4-2e7adeb3d7fa response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100902024-12-20T22:25:17.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c972b212-4bfd-4f0b-b7c4-d07f66cd6b77 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100912024-12-20T22:25:17.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c972b212-4bfd-4f0b-b7c4-d07f66cd6b77 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100922024-12-20T22:25:17.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c972b212-4bfd-4f0b-b7c4-d07f66cd6b77 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100932024-12-20T22:25:18.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d5d1404e-d2be-4401-badd-6ac47dc18db8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100942024-12-20T22:25:18.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d5d1404e-d2be-4401-badd-6ac47dc18db8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100952024-12-20T22:25:18.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d5d1404e-d2be-4401-badd-6ac47dc18db8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100962024-12-20T22:25:20.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 43d77277-54ee-4b05-8e07-5ba3e751040f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100972024-12-20T22:25:20.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 43d77277-54ee-4b05-8e07-5ba3e751040f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100982024-12-20T22:25:20.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 43d77277-54ee-4b05-8e07-5ba3e751040f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
100992024-12-20T22:25:21.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 336929b9-f978-4a2a-af77-77cfa266b0b8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101002024-12-20T22:25:21.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 336929b9-f978-4a2a-af77-77cfa266b0b8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101012024-12-20T22:25:21.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 336929b9-f978-4a2a-af77-77cfa266b0b8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101022024-12-20T22:25:22.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9db1a961-f679-4f09-b64f-869ffe72717e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101032024-12-20T22:25:22.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9db1a961-f679-4f09-b64f-869ffe72717e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101042024-12-20T22:25:22.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9db1a961-f679-4f09-b64f-869ffe72717e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101052024-12-20T22:25:23.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8d446a3-bf9a-4621-95ae-4c9796232e4b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101062024-12-20T22:25:23.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8d446a3-bf9a-4621-95ae-4c9796232e4b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101072024-12-20T22:25:23.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8d446a3-bf9a-4621-95ae-4c9796232e4b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101082024-12-20T22:25:23.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
101092024-12-20T22:25:23.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101102024-12-20T22:25:23.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
101112024-12-20T22:25:23.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101122024-12-20T22:25:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101132024-12-20T22:25:23.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101142024-12-20T22:25:23.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101152024-12-20T22:25:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101162024-12-20T22:25:23.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101172024-12-20T22:25:23.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.230312ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101182024-12-20T22:25:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101192024-12-20T22:25:23.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101202024-12-20T22:25:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101212024-12-20T22:25:23.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101222024-12-20T22:25:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101232024-12-20T22:25:23.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101242024-12-20T22:25:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
101252024-12-20T22:25:23.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101262024-12-20T22:25:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101272024-12-20T22:25:23.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
101282024-12-20T22:25:23.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.624767ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
101292024-12-20T22:25:24.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5cc3f27e-ce2c-4e46-986f-14bb069cddaf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101302024-12-20T22:25:24.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5cc3f27e-ce2c-4e46-986f-14bb069cddaf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101312024-12-20T22:25:24.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5cc3f27e-ce2c-4e46-986f-14bb069cddaf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101322024-12-20T22:25:25.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d9709111-5528-42dc-b03b-69997e7bd2a4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101332024-12-20T22:25:25.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d9709111-5528-42dc-b03b-69997e7bd2a4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101342024-12-20T22:25:25.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d9709111-5528-42dc-b03b-69997e7bd2a4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101352024-12-20T22:25:25.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1365 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = be754c28-b173-4cba-8064-4d1065ae6432 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
101362024-12-20T22:25:26.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9dc4a198-05f2-479d-8fc2-7a11cebea795 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101372024-12-20T22:25:26.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9dc4a198-05f2-479d-8fc2-7a11cebea795 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101382024-12-20T22:25:26.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9dc4a198-05f2-479d-8fc2-7a11cebea795 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101392024-12-20T22:25:27.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 03b8a4f2-0f07-4277-b419-73e573bc4d7c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
101402024-12-20T22:25:27.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 03b8a4f2-0f07-4277-b419-73e573bc4d7c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
101412024-12-20T22:25:27.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 03b8a4f2-0f07-4277-b419-73e573bc4d7c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
101422024-12-20T22:25:27.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 6f2f5b32-2b71-4ab0-98b8-fdab785b36e2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
101432024-12-20T22:25:27.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 6f2f5b32-2b71-4ab0-98b8-fdab785b36e2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
101442024-12-20T22:25:27.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 6f2f5b32-2b71-4ab0-98b8-fdab785b36e2 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
101452024-12-20T22:25:27.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1702de9a-404d-4d99-a3aa-0630041d9014 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101462024-12-20T22:25:27.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1702de9a-404d-4d99-a3aa-0630041d9014 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101472024-12-20T22:25:27.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1702de9a-404d-4d99-a3aa-0630041d9014 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101482024-12-20T22:25:28.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 729127fe-a343-4828-a23a-2309f0580ecd roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101492024-12-20T22:25:28.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 729127fe-a343-4828-a23a-2309f0580ecd resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101502024-12-20T22:25:28.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 729127fe-a343-4828-a23a-2309f0580ecd response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101512024-12-20T22:25:29.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ddb4a59a-edcc-4f59-8175-9e09771d94c1 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101522024-12-20T22:25:29.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ddb4a59a-edcc-4f59-8175-9e09771d94c1 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101532024-12-20T22:25:29.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ddb4a59a-edcc-4f59-8175-9e09771d94c1 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101542024-12-20T22:25:30.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8ab5d75a-a455-4bb4-8575-8a6bbb3b02be roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101552024-12-20T22:25:30.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8ab5d75a-a455-4bb4-8575-8a6bbb3b02be resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101562024-12-20T22:25:30.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8ab5d75a-a455-4bb4-8575-8a6bbb3b02be response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101572024-12-20T22:25:31.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 474565e1-e864-4599-acb0-a38b2c9ee10b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101582024-12-20T22:25:31.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 474565e1-e864-4599-acb0-a38b2c9ee10b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101592024-12-20T22:25:31.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 474565e1-e864-4599-acb0-a38b2c9ee10b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101602024-12-20T22:25:32.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2ac63f85-ee77-4fd0-9e2b-2c439a15ee05 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101612024-12-20T22:25:32.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2ac63f85-ee77-4fd0-9e2b-2c439a15ee05 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101622024-12-20T22:25:32.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2ac63f85-ee77-4fd0-9e2b-2c439a15ee05 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101632024-12-20T22:25:33.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c8b6da46-0a3e-4a1b-aaa8-7f738f5958bd roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101642024-12-20T22:25:33.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c8b6da46-0a3e-4a1b-aaa8-7f738f5958bd resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101652024-12-20T22:25:33.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c8b6da46-0a3e-4a1b-aaa8-7f738f5958bd response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101662024-12-20T22:25:33.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
101672024-12-20T22:25:33.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
101682024-12-20T22:25:33.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101692024-12-20T22:25:33.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101702024-12-20T22:25:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101712024-12-20T22:25:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101722024-12-20T22:25:33.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101732024-12-20T22:25:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101742024-12-20T22:25:33.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101752024-12-20T22:25:33.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.065261ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101762024-12-20T22:25:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101772024-12-20T22:25:33.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101782024-12-20T22:25:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101792024-12-20T22:25:33.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101802024-12-20T22:25:33.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101812024-12-20T22:25:33.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101822024-12-20T22:25:33.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
101832024-12-20T22:25:33.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101842024-12-20T22:25:33.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101852024-12-20T22:25:33.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
101862024-12-20T22:25:33.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.349865ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
101872024-12-20T22:25:34.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fc0c1ed2-1de9-4605-b078-4faa024eb20d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101882024-12-20T22:25:34.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fc0c1ed2-1de9-4605-b078-4faa024eb20d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101892024-12-20T22:25:34.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fc0c1ed2-1de9-4605-b078-4faa024eb20d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
101902024-12-20T22:25:34.448ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565 remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1e258205-0f57-45ab-a7dd-bcff1f1f1100 uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-20T22:25:34.446018874Z }
101912024-12-20T22:25:34.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1e258205-0f57-45ab-a7dd-bcff1f1f1100 roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
101922024-12-20T22:25:34.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1e258205-0f57-45ab-a7dd-bcff1f1f1100 resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
101932024-12-20T22:25:34.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17506 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1e258205-0f57-45ab-a7dd-bcff1f1f1100 response_code = 204 uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
101942024-12-20T22:25:34.464ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565 remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ac5538e9-7058-40b6-9bc9-68c340939b85 uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T22:25:34.464067156Z }
101952024-12-20T22:25:34.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ac5538e9-7058-40b6-9bc9-68c340939b85 roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
101962024-12-20T22:25:34.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ac5538e9-7058-40b6-9bc9-68c340939b85 resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
101972024-12-20T22:25:34.482ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:44872
101982024-12-20T22:25:34.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44872 req_id = 244e7eef-91b2-4f61-b148-10b4b8b657f7 roles = RoleSet { roles: {} } uri = /metrics/producers
101992024-12-20T22:25:34.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44872 req_id = 244e7eef-91b2-4f61-b148-10b4b8b657f7 resource = Database result = Ok(()) uri = /metrics/producers
102002024-12-20T22:25:34.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38280 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ac5538e9-7058-40b6-9bc9-68c340939b85 response_code = 204 uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
102012024-12-20T22:25:34.522ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7
102022024-12-20T22:25:34.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39766 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44872 req_id = 244e7eef-91b2-4f61-b148-10b4b8b657f7 response_code = 201 uri = /metrics/producers
102032024-12-20T22:25:35.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5c7d5a20-5802-4f2d-bc38-a3a8b8e17c5d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102042024-12-20T22:25:35.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5c7d5a20-5802-4f2d-bc38-a3a8b8e17c5d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102052024-12-20T22:25:35.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5c7d5a20-5802-4f2d-bc38-a3a8b8e17c5d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102062024-12-20T22:25:35.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1364 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = b6a89d8f-a7f9-4c29-b10e-ca43bcd1a610 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
102072024-12-20T22:25:36.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d20fef08-eeae-49d9-afbc-65872963e218 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102082024-12-20T22:25:36.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d20fef08-eeae-49d9-afbc-65872963e218 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102092024-12-20T22:25:36.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d20fef08-eeae-49d9-afbc-65872963e218 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102102024-12-20T22:25:37.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff743e8e-69f7-4c7c-948c-4a00b6067368 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102112024-12-20T22:25:37.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff743e8e-69f7-4c7c-948c-4a00b6067368 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102122024-12-20T22:25:37.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff743e8e-69f7-4c7c-948c-4a00b6067368 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102132024-12-20T22:25:38.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c05199ab-1cdd-4348-aa7a-9e1c26c67b3e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102142024-12-20T22:25:38.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c05199ab-1cdd-4348-aa7a-9e1c26c67b3e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102152024-12-20T22:25:38.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c05199ab-1cdd-4348-aa7a-9e1c26c67b3e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102162024-12-20T22:25:39.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bd2952de-6e96-4ac9-bc93-1b58f530aa7e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102172024-12-20T22:25:39.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bd2952de-6e96-4ac9-bc93-1b58f530aa7e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102182024-12-20T22:25:39.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bd2952de-6e96-4ac9-bc93-1b58f530aa7e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102192024-12-20T22:25:40.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a01a9772-9448-436a-82ca-dadd9e65f75f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102202024-12-20T22:25:40.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a01a9772-9448-436a-82ca-dadd9e65f75f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102212024-12-20T22:25:40.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a01a9772-9448-436a-82ca-dadd9e65f75f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102222024-12-20T22:25:41.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e9336796-9c2a-4c5a-8f43-b548dbf440c9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102232024-12-20T22:25:41.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e9336796-9c2a-4c5a-8f43-b548dbf440c9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102242024-12-20T22:25:41.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e9336796-9c2a-4c5a-8f43-b548dbf440c9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102252024-12-20T22:25:42.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9b545322-b5aa-4711-8b01-900ccc23c89f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102262024-12-20T22:25:42.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9b545322-b5aa-4711-8b01-900ccc23c89f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102272024-12-20T22:25:42.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9b545322-b5aa-4711-8b01-900ccc23c89f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
102282024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
102292024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
102302024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
102312024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
102322024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102332024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
102342024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
102352024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102362024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
102372024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
102382024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102392024-12-20T22:25:43.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102402024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
102412024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102422024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
102432024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
102442024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
102452024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102462024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
102472024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102482024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
102492024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102502024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
102512024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
102522024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102532024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
102542024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
102552024-12-20T22:25:43.445ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
102562024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
102572024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102582024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
102592024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102602024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102612024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
102622024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102632024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102642024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102652024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
102662024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102672024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102682024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102692024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102702024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102712024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102722024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102732024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102742024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102752024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
102762024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102772024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102782024-12-20T22:25:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102792024-12-20T22:25:43.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1570, tv_nsec: 373756091 } })
102802024-12-20T22:25:43.448ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.585126ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102812024-12-20T22:25:43.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
102822024-12-20T22:25:43.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1570, tv_nsec: 374361287 } })
102832024-12-20T22:25:43.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102842024-12-20T22:25:43.449ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
102852024-12-20T22:25:43.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102862024-12-20T22:25:43.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102872024-12-20T22:25:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102882024-12-20T22:25:43.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102892024-12-20T22:25:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102902024-12-20T22:25:43.452ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102912024-12-20T22:25:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102922024-12-20T22:25:43.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102932024-12-20T22:25:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102942024-12-20T22:25:43.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102952024-12-20T22:25:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102962024-12-20T22:25:43.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102972024-12-20T22:25:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102982024-12-20T22:25:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102992024-12-20T22:25:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
103002024-12-20T22:25:43.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103012024-12-20T22:25:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103022024-12-20T22:25:43.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103032024-12-20T22:25:43.462ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.488316ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
103042024-12-20T22:25:43.462ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103052024-12-20T22:25:43.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103062024-12-20T22:25:43.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103072024-12-20T22:25:43.462ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103082024-12-20T22:25:43.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103092024-12-20T22:25:43.464ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103102024-12-20T22:25:43.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103112024-12-20T22:25:43.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103122024-12-20T22:25:43.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 20.991911ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103132024-12-20T22:25:43.465ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103142024-12-20T22:25:43.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103152024-12-20T22:25:43.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
103162024-12-20T22:25:43.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103172024-12-20T22:25:43.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103182024-12-20T22:25:43.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103192024-12-20T22:25:43.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103202024-12-20T22:25:43.467ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103212024-12-20T22:25:43.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103222024-12-20T22:25:43.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103232024-12-20T22:25:43.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103242024-12-20T22:25:43.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103252024-12-20T22:25:43.469ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1570, tv_nsec: 395336339 } })
103262024-12-20T22:25:43.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.186214ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103272024-12-20T22:25:43.470ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
103282024-12-20T22:25:43.470ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103292024-12-20T22:25:43.472ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103302024-12-20T22:25:43.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103312024-12-20T22:25:43.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103322024-12-20T22:25:43.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103332024-12-20T22:25:43.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103342024-12-20T22:25:43.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103352024-12-20T22:25:43.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103362024-12-20T22:25:43.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
103372024-12-20T22:25:43.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103382024-12-20T22:25:43.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103392024-12-20T22:25:43.486ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 41.450827ms iteration = 28 status = {"physical_disks_added":0}
103402024-12-20T22:25:43.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.358997ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
103412024-12-20T22:25:43.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103422024-12-20T22:25:43.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103432024-12-20T22:25:43.506ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103442024-12-20T22:25:43.506ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
103452024-12-20T22:25:43.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103462024-12-20T22:25:43.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103472024-12-20T22:25:43.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103482024-12-20T22:25:43.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103492024-12-20T22:25:43.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.235886ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103502024-12-20T22:25:43.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ad4764e5-49cc-40cf-bbc2-a528e25c157e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
103512024-12-20T22:25:43.563ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
103522024-12-20T22:25:43.563ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103532024-12-20T22:25:43.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ad4764e5-49cc-40cf-bbc2-a528e25c157e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
103542024-12-20T22:25:43.563ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c47a6ebd-cc4b-40ff-b695-eae5ab1fc9dc", "content-length": "26", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
103552024-12-20T22:25:43.563ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103562024-12-20T22:25:43.565ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103572024-12-20T22:25:43.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103582024-12-20T22:25:43.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103592024-12-20T22:25:43.644ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565/state
103602024-12-20T22:25:43.644ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd98e425-44cd-48ea-9508-d553a943a676", "content-length": "130", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
103612024-12-20T22:25:43.644ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 sled_id = a0a780c3-0806-4044-8e4b-e91bf0405221 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T22:25:34.464067156Z }, migration_in: None, migration_out: None } vmm_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565
103622024-12-20T22:25:43.644ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565 sled_id = a0a780c3-0806-4044-8e4b-e91bf0405221 vmm_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T22:25:34.464067156Z }
103632024-12-20T22:25:43.644ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 roles = RoleSet { roles: {} } sled_id = a0a780c3-0806-4044-8e4b-e91bf0405221 vmm_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565
103642024-12-20T22:25:43.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 resource = Database result = Ok(()) sled_id = a0a780c3-0806-4044-8e4b-e91bf0405221 vmm_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565
103652024-12-20T22:25:43.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
103662024-12-20T22:25:43.645ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103672024-12-20T22:25:43.646ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6da9661a-406c-4424-a316-177cba735092", "content-length": "26", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
103682024-12-20T22:25:43.646ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103692024-12-20T22:25:43.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
103702024-12-20T22:25:43.654ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
103712024-12-20T22:25:43.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 209.71035ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
103722024-12-20T22:25:43.667ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
103732024-12-20T22:25:43.667ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103742024-12-20T22:25:43.667ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4be3f03-54e0-4ee2-a10b-c29335b1ff74", "content-length": "26", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
103752024-12-20T22:25:43.667ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103762024-12-20T22:25:43.669ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103772024-12-20T22:25:43.703ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103782024-12-20T22:25:43.703ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103792024-12-20T22:25:43.703ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4734a7ac-f896-4bd4-abc7-8b2e972a1dce", "content-length": "585", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
103802024-12-20T22:25:43.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103812024-12-20T22:25:43.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103822024-12-20T22:25:43.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ad4764e5-49cc-40cf-bbc2-a528e25c157e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
103832024-12-20T22:25:43.707ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103842024-12-20T22:25:43.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103852024-12-20T22:25:43.708ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103862024-12-20T22:25:43.708ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
103872024-12-20T22:25:43.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103882024-12-20T22:25:43.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103892024-12-20T22:25:43.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103902024-12-20T22:25:43.711ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
103912024-12-20T22:25:43.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
103922024-12-20T22:25:43.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103932024-12-20T22:25:43.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103942024-12-20T22:25:43.713ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 268.746254ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
103952024-12-20T22:25:43.714ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 269.1897ms iteration = 24 status = 0
103962024-12-20T22:25:43.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103972024-12-20T22:25:43.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103982024-12-20T22:25:43.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103992024-12-20T22:25:43.740ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104002024-12-20T22:25:43.740ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
104012024-12-20T22:25:43.740ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 295.782557ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
104022024-12-20T22:25:43.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104032024-12-20T22:25:43.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104042024-12-20T22:25:43.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104052024-12-20T22:25:43.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104062024-12-20T22:25:43.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104072024-12-20T22:25:43.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104082024-12-20T22:25:43.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104092024-12-20T22:25:43.759ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {05657aa9-faf8-49fd-bc08-cf5f21f28d75: {10.151.2.175: {8a54a328-05f7-4d01-9c00-86fea068fa1c}, 10.151.2.176: {8a54a328-05f7-4d01-9c00-86fea068fa1c}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
104102024-12-20T22:25:43.759ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
104112024-12-20T22:25:43.759ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ab8a6fe0-ca36-4ab4-ba3b-c99e038b0050", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
104122024-12-20T22:25:43.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104132024-12-20T22:25:43.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104142024-12-20T22:25:43.761ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
104152024-12-20T22:25:43.761ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "007c1a89-7628-4fe7-9768-97c0e01e8610", "content-length": "1", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
104162024-12-20T22:25:43.764ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104172024-12-20T22:25:43.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104182024-12-20T22:25:43.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104192024-12-20T22:25:43.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104202024-12-20T22:25:43.773ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 329.010751ms iteration = 24 status = null
104212024-12-20T22:25:43.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104222024-12-20T22:25:43.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104232024-12-20T22:25:43.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104242024-12-20T22:25:43.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104252024-12-20T22:25:43.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104262024-12-20T22:25:43.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104272024-12-20T22:25:43.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104282024-12-20T22:25:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104292024-12-20T22:25:43.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 352.560009ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
104302024-12-20T22:25:43.799ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
104312024-12-20T22:25:43.799ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
104322024-12-20T22:25:43.799ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104332024-12-20T22:25:43.801ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cc4b3476-dd98-4855-aad7-5e7101edda38", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
104342024-12-20T22:25:43.803ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 358.266696ms iteration = 25 status = {}
104352024-12-20T22:25:43.827ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 382.297338ms iteration = 24 status = {}
104362024-12-20T22:25:43.872ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
104372024-12-20T22:25:43.873ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bc8624d-637a-41ea-84c4-17f56a8f87cd", "content-length": "811", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
104382024-12-20T22:25:43.873ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(14299089) }} sled = sock
104392024-12-20T22:25:43.873ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
104402024-12-20T22:25:43.873ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
104412024-12-20T22:25:43.874ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 429.972747ms iteration = 24 status = {}
104422024-12-20T22:25:43.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104432024-12-20T22:25:43.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104442024-12-20T22:25:43.884ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
104452024-12-20T22:25:43.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104462024-12-20T22:25:43.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104472024-12-20T22:25:43.894ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
104482024-12-20T22:25:43.894ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "90ba28c0-0fd4-41ce-93c8-bc6b6542d59b", "content-length": "134", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
104492024-12-20T22:25:43.894ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
104502024-12-20T22:25:43.894ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
104512024-12-20T22:25:43.895ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
104522024-12-20T22:25:43.895ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
104532024-12-20T22:25:43.895ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104542024-12-20T22:25:43.895ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104552024-12-20T22:25:43.895ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104562024-12-20T22:25:43.895ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104572024-12-20T22:25:43.895ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104582024-12-20T22:25:43.895ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104592024-12-20T22:25:43.895ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
104602024-12-20T22:25:43.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104612024-12-20T22:25:43.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104622024-12-20T22:25:43.897ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
104632024-12-20T22:25:43.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fad4690-1a6c-4dec-9212-28766f0dc50c", "content-length": "2", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
104642024-12-20T22:25:43.897ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
104652024-12-20T22:25:43.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "40c199f6-2788-4253-9534-6dfc4615cc2a", "content-length": "52", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
104662024-12-20T22:25:43.898ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
104672024-12-20T22:25:43.898ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
104682024-12-20T22:25:43.997ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a109f57b-bcab-4e83-a5a7-677e4460036a", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
104692024-12-20T22:25:43.997ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
104702024-12-20T22:25:43.997ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
104712024-12-20T22:25:43.998ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3d9a708-bf6f-4d5f-b1a0-09829036bacc", "content-length": "682", "date": "Fri, 20 Dec 2024 22:25:43 GMT"} })
104722024-12-20T22:25:43.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104732024-12-20T22:25:43.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104742024-12-20T22:25:44.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104752024-12-20T22:25:44.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104762024-12-20T22:25:44.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104772024-12-20T22:25:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104782024-12-20T22:25:44.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104792024-12-20T22:25:44.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104802024-12-20T22:25:44.016ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 571.408711ms iteration = 24 status = {}
104812024-12-20T22:25:44.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 187196fa-522f-4ce3-b3f7-b5684ca84918 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
104822024-12-20T22:25:44.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 187196fa-522f-4ce3-b3f7-b5684ca84918 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
104832024-12-20T22:25:44.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 187196fa-522f-4ce3-b3f7-b5684ca84918 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
104842024-12-20T22:25:44.925ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565 remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23eb3f25-6da3-48d2-85ff-5dc4d0bfebb7 uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-20T22:25:44.925631700Z }
104852024-12-20T22:25:44.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23eb3f25-6da3-48d2-85ff-5dc4d0bfebb7 roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
104862024-12-20T22:25:44.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23eb3f25-6da3-48d2-85ff-5dc4d0bfebb7 resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
104872024-12-20T22:25:44.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8393 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 23eb3f25-6da3-48d2-85ff-5dc4d0bfebb7 response_code = 204 uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
104882024-12-20T22:25:45.693ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4142 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 6b25eed1-0f62-4853-903b-67f93bd93e09 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
104892024-12-20T22:25:45.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fb66c7c5-8626-47b3-8a5e-a62f628d98d9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
104902024-12-20T22:25:45.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fb66c7c5-8626-47b3-8a5e-a62f628d98d9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
104912024-12-20T22:25:45.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fb66c7c5-8626-47b3-8a5e-a62f628d98d9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
104922024-12-20T22:25:46.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = bfa7fa55-5876-4695-a028-71840aefd5cd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
104932024-12-20T22:25:46.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = bfa7fa55-5876-4695-a028-71840aefd5cd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
104942024-12-20T22:25:46.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = bfa7fa55-5876-4695-a028-71840aefd5cd response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
104952024-12-20T22:25:46.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 0eab4cbd-9c81-4ef9-82d9-c570e8b0df29 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
104962024-12-20T22:25:46.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 0eab4cbd-9c81-4ef9-82d9-c570e8b0df29 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
104972024-12-20T22:25:46.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 0eab4cbd-9c81-4ef9-82d9-c570e8b0df29 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
104982024-12-20T22:25:46.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8fbe6e77-8efd-4c2f-a2cf-5a5da50fc5ff roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
104992024-12-20T22:25:46.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8fbe6e77-8efd-4c2f-a2cf-5a5da50fc5ff resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
105002024-12-20T22:25:46.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8fbe6e77-8efd-4c2f-a2cf-5a5da50fc5ff response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
105012024-12-20T22:25:47.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 8108fe74-2a8d-4748-87d1-4f614368e195 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
105022024-12-20T22:25:47.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 8108fe74-2a8d-4748-87d1-4f614368e195 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
105032024-12-20T22:25:47.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 8108fe74-2a8d-4748-87d1-4f614368e195 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
105042024-12-20T22:25:47.386ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565 remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T22:25:47.385960983Z }
105052024-12-20T22:25:47.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105062024-12-20T22:25:47.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105072024-12-20T22:25:47.426ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565 remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565 vmm_needs_update = true
105082024-12-20T22:25:47.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105092024-12-20T22:25:47.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105102024-12-20T22:25:47.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105112024-12-20T22:25:47.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105122024-12-20T22:25:47.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105132024-12-20T22:25:47.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105142024-12-20T22:25:47.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105152024-12-20T22:25:47.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105162024-12-20T22:25:47.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105172024-12-20T22:25:47.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105182024-12-20T22:25:47.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105192024-12-20T22:25:47.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105202024-12-20T22:25:47.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105212024-12-20T22:25:47.494ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 79569914-721c-4af5-b3de-b3d4df7ef204, lookup_type: ById(79569914-721c-4af5-b3de-b3d4df7ef204) }, key: d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3, lookup_type: ById(d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3) }, key: e0e12a47-30ee-446d-9cc5-4e57bdbf39c7, lookup_type: ById(e0e12a47-30ee-446d-9cc5-4e57bdbf39c7) } result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105222024-12-20T22:25:47.494ZINFOnexus (dropshot_internal): starting update saga for e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T22:25:47.385960983Z }
105232024-12-20T22:25:47.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108245 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad response_code = 204 uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105242024-12-20T22:25:47.494ZDEBGnexus (dropshot_internal): preparing instance-update saga for e0e12a47-30ee-446d-9cc5-4e57bdbf39c7... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a9b6ce0a-b65b-4a9a-be2f-5dc5f8669fad uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105252024-12-20T22:25:47.494ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update
105262024-12-20T22:25:47.494ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"e0e12a47-30ee-446d-9cc5-4e57bdbf39c7","lookup_type":{"ById":"e0e12a47-30ee-446d-9cc5-4e57bdbf39c7"},"parent":{"key":"d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3","lookup_type":{"ById":"d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3"},"parent":{"key":"79569914-721c-4af5-b3de-b3d4df7ef204","lookup_type":{"ById":"79569914-721c-4af5-b3de-b3d4df7ef204"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105272024-12-20T22:25:47.494ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update
105282024-12-20T22:25:47.494ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565 remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2238551d-38e8-4dbf-aeec-5d1a83247e3c uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T22:25:47.385960983Z }
105292024-12-20T22:25:47.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2238551d-38e8-4dbf-aeec-5d1a83247e3c roles = RoleSet { roles: {} } uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105302024-12-20T22:25:47.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2238551d-38e8-4dbf-aeec-5d1a83247e3c resource = Database result = Ok(()) uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105312024-12-20T22:25:47.530ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update
105322024-12-20T22:25:47.530ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105332024-12-20T22:25:47.530ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105342024-12-20T22:25:47.530ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
105352024-12-20T22:25:47.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35935 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2238551d-38e8-4dbf-aeec-5d1a83247e3c response_code = 204 uri = /vmms/0b768c17-53e3-4ff3-bbb7-28fc2ebda565
105362024-12-20T22:25:47.535ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105372024-12-20T22:25:47.535ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
105382024-12-20T22:25:47.538ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105392024-12-20T22:25:47.538ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
105402024-12-20T22:25:47.542ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105412024-12-20T22:25:47.542ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("8c7cb4c3-ebb8-40af-ad87-dac3523e9958")) node_id = 0 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
105422024-12-20T22:25:47.545ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105432024-12-20T22:25:47.545ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
105442024-12-20T22:25:47.548ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update
105452024-12-20T22:25:47.548ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105462024-12-20T22:25:47.549ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105472024-12-20T22:25:47.551ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105482024-12-20T22:25:47.551ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105492024-12-20T22:25:47.553ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105502024-12-20T22:25:47.553ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105512024-12-20T22:25:47.555ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105522024-12-20T22:25:47.555ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105532024-12-20T22:25:47.556ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105542024-12-20T22:25:47.556ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105552024-12-20T22:25:47.590ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105562024-12-20T22:25:47.591ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105572024-12-20T22:25:47.592ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105582024-12-20T22:25:47.595ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 79569914-721c-4af5-b3de-b3d4df7ef204, lookup_type: ById(79569914-721c-4af5-b3de-b3d4df7ef204) }, key: d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3, lookup_type: ById(d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3) }, key: e0e12a47-30ee-446d-9cc5-4e57bdbf39c7, lookup_type: ById(e0e12a47-30ee-446d-9cc5-4e57bdbf39c7) } result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105592024-12-20T22:25:47.595ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance updater_id = 8c7cb4c3-ebb8-40af-ad87-dac3523e9958
105602024-12-20T22:25:47.595ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105612024-12-20T22:25:47.596ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105622024-12-20T22:25:47.605ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance updater_id = 8c7cb4c3-ebb8-40af-ad87-dac3523e9958
105632024-12-20T22:25:47.605ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105642024-12-20T22:25:47.605ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance
105652024-12-20T22:25:47.609ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 locked_gen = Generation(Generation(2)) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = LockInstance updater_id = 8c7cb4c3-ebb8-40af-ad87-dac3523e9958
105662024-12-20T22:25:47.609ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105672024-12-20T22:25:47.609ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("8c7cb4c3-ebb8-40af-ad87-dac3523e9958")}) node_id = 1 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
105682024-12-20T22:25:47.613ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105692024-12-20T22:25:47.613ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
105702024-12-20T22:25:47.619ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105712024-12-20T22:25:47.619ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105722024-12-20T22:25:47.620ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105732024-12-20T22:25:47.620ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105742024-12-20T22:25:47.622ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105752024-12-20T22:25:47.622ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105762024-12-20T22:25:47.623ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105772024-12-20T22:25:47.626ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 79569914-721c-4af5-b3de-b3d4df7ef204, lookup_type: ById(79569914-721c-4af5-b3de-b3d4df7ef204) }, key: d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3, lookup_type: ById(d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3) }, key: e0e12a47-30ee-446d-9cc5-4e57bdbf39c7, lookup_type: ById(e0e12a47-30ee-446d-9cc5-4e57bdbf39c7) } result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105782024-12-20T22:25:47.626ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105792024-12-20T22:25:47.626ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105802024-12-20T22:25:47.631ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 0b768c17-53e3-4ff3-bbb7-28fc2ebda565, time_created: 2024-12-20T22:25:26.313158Z, time_deleted: None, instance_id: e0e12a47-30ee-446d-9cc5-4e57bdbf39c7, sled_id: a0a780c3-0806-4044-8e4b-e91bf0405221, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-20T22:25:47.385960Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-20T22:25:23.691631Z, gen: Generation(Generation(3)), propolis_id: Some(0b768c17-53e3-4ff3-bbb7-28fc2ebda565), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(0b768c17-53e3-4ff3-bbb7-28fc2ebda565 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-20T22:25:47.631865745Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
105812024-12-20T22:25:47.634ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
105822024-12-20T22:25:47.636ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"e0e12a47-30ee-446d-9cc5-4e57bdbf39c7","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"0b768c17-53e3-4ff3-bbb7-28fc2ebda565"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"e0e12a47-30ee-446d-9cc5-4e57bdbf39c7","lookup_type":{"ById":"e0e12a47-30ee-446d-9cc5-4e57bdbf39c7"},"parent":{"key":"d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3","lookup_type":{"ById":"d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3"},"parent":{"key":"79569914-721c-4af5-b3de-b3d4df7ef204","lookup_type":{"ById":"79569914-721c-4af5-b3de-b3d4df7ef204"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"8c7cb4c3-ebb8-40af-ad87-dac3523e9958"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3","ram_diff":1073741824},"destroy_active_vmm":"0b768c17-53e3-4ff3-bbb7-28fc2ebda565","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-20T22:25:47.631865745Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105832024-12-20T22:25:47.636ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
105842024-12-20T22:25:47.667ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
105852024-12-20T22:25:47.667ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105862024-12-20T22:25:47.667ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105872024-12-20T22:25:47.667ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
105882024-12-20T22:25:47.671ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105892024-12-20T22:25:47.671ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
105902024-12-20T22:25:47.674ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105912024-12-20T22:25:47.675ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
105922024-12-20T22:25:47.678ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105932024-12-20T22:25:47.678ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("522f27ca-4001-4559-b605-2e284cc9f210")) node_id = 0 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
105942024-12-20T22:25:47.681ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
105952024-12-20T22:25:47.681ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
105962024-12-20T22:25:47.684ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 parent_lock = UpdaterLock { updater_id: 8c7cb4c3-ebb8-40af-ad87-dac3523e9958, locked_gen: Generation(Generation(2)) } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
105972024-12-20T22:25:47.684ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = BecomeUpdater
105982024-12-20T22:25:47.684ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = BecomeUpdater
105992024-12-20T22:25:47.702ZDEBGnexus (SagaExecutor): inherited lock from 8c7cb4c3-ebb8-40af-ad87-dac3523e9958 to 522f27ca-4001-4559-b605-2e284cc9f210 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 8c7cb4c3-ebb8-40af-ad87-dac3523e9958 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = BecomeUpdater updater_id = 522f27ca-4001-4559-b605-2e284cc9f210
106002024-12-20T22:25:47.702ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106012024-12-20T22:25:47.702ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106022024-12-20T22:25:47.702ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("522f27ca-4001-4559-b605-2e284cc9f210")}) node_id = 1 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106032024-12-20T22:25:47.706ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106042024-12-20T22:25:47.706ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106052024-12-20T22:25:47.710ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106062024-12-20T22:25:47.710ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106072024-12-20T22:25:47.713ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106082024-12-20T22:25:47.713ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106092024-12-20T22:25:47.716ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106102024-12-20T22:25:47.716ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7
106112024-12-20T22:25:47.719ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = UpdateNetworkConfig
106122024-12-20T22:25:47.719ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = UpdateNetworkConfig
106132024-12-20T22:25:47.721ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = UpdateNetworkConfig
106142024-12-20T22:25:47.722ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = UpdateNetworkConfig
106152024-12-20T22:25:47.724ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
106162024-12-20T22:25:47.724ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = UpdateNetworkConfig
106172024-12-20T22:25:47.724ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = UpdateNetworkConfig
106182024-12-20T22:25:47.726ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
106192024-12-20T22:25:47.726ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
106202024-12-20T22:25:47.726ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
106212024-12-20T22:25:47.727ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
106222024-12-20T22:25:47.728ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
106232024-12-20T22:25:47.728ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
106242024-12-20T22:25:47.728ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
106252024-12-20T22:25:47.733ZDEBGnexus: notifying dendrite of updates instance_id = Some(e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 (instance)) switch = switch0
106262024-12-20T22:25:47.733ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 659134189 } })
106272024-12-20T22:25:47.734ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
106282024-12-20T22:25:47.764ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106292024-12-20T22:25:47.764ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106302024-12-20T22:25:47.764ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd9cb6fa-efa5-48b2-996e-f106f20f82a7", "content-length": "26", "date": "Fri, 20 Dec 2024 22:25:47 GMT"} })
106312024-12-20T22:25:47.764ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106322024-12-20T22:25:47.765ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106332024-12-20T22:25:47.795ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
106342024-12-20T22:25:47.795ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "72703352-cdd9-4da2-8128-eb182324d186", "content-length": "4", "date": "Fri, 20 Dec 2024 22:25:47 GMT"} })
106352024-12-20T22:25:47.798ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106362024-12-20T22:25:47.798ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106372024-12-20T22:25:47.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff50e3e3-0d59-4f50-b46d-b986e8b9687d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
106382024-12-20T22:25:47.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff50e3e3-0d59-4f50-b46d-b986e8b9687d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
106392024-12-20T22:25:47.801ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106402024-12-20T22:25:47.801ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106412024-12-20T22:25:47.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ff50e3e3-0d59-4f50-b46d-b986e8b9687d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
106422024-12-20T22:25:47.805ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
106432024-12-20T22:25:47.805ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
106442024-12-20T22:25:47.827ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-20T22:25:47.807674Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 79569914-721c-4af5-b3de-b3d4df7ef204, time_modified: Some(2024-12-20T22:25:47.807674Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3, time_modified: Some(2024-12-20T22:25:47.807674Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106452024-12-20T22:25:47.827ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106462024-12-20T22:25:47.827ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106472024-12-20T22:25:47.830ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106482024-12-20T22:25:47.830ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106492024-12-20T22:25:47.834ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106502024-12-20T22:25:47.834ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = UnassignOximeterProducer
106512024-12-20T22:25:47.834ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = UnassignOximeterProducer
106522024-12-20T22:25:47.838ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac producer_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106532024-12-20T22:25:47.838ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = UnassignOximeterProducer
106542024-12-20T22:25:47.838ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = UnassignOximeterProducer
106552024-12-20T22:25:47.874ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106562024-12-20T22:25:47.876ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/e0e12a47-30ee-446d-9cc5-4e57bdbf39c7
106572024-12-20T22:25:47.894ZDEBGnexus (SagaExecutor): client response oximeter-collector = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/e0e12a47-30ee-446d-9cc5-4e57bdbf39c7", status: 204, headers: {"x-request-id": "3f229ef7-b459-4be6-b8ee-32ff89a43096", "date": "Fri, 20 Dec 2024 22:25:47 GMT"} }) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106582024-12-20T22:25:47.894ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac producer_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106592024-12-20T22:25:47.895ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106602024-12-20T22:25:47.895ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106612024-12-20T22:25:47.899ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106622024-12-20T22:25:47.899ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106632024-12-20T22:25:47.902ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 lock = UpdaterLock { updater_id: 522f27ca-4001-4559-b605-2e284cc9f210, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-20T22:25:47.631865745Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106642024-12-20T22:25:47.904ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = CommitInstanceUpdates
106652024-12-20T22:25:47.905ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = CommitInstanceUpdates
106662024-12-20T22:25:47.944ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 new_runtime = InstanceRuntimeState { time_updated: 2024-12-20T22:25:47.631865745Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106672024-12-20T22:25:47.944ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106682024-12-20T22:25:47.944ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106692024-12-20T22:25:47.944ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
106702024-12-20T22:25:47.944ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
106712024-12-20T22:25:47.944ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
106722024-12-20T22:25:47.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106732024-12-20T22:25:47.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106742024-12-20T22:25:47.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106752024-12-20T22:25:47.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106762024-12-20T22:25:47.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106772024-12-20T22:25:47.948ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106782024-12-20T22:25:47.948ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106792024-12-20T22:25:47.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106802024-12-20T22:25:47.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106812024-12-20T22:25:47.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106822024-12-20T22:25:47.950ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106832024-12-20T22:25:47.951ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106842024-12-20T22:25:47.951ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("e0e12a47-30ee-446d-9cc5-4e57bdbf39c7"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0b768c17-53e3-4ff3-bbb7-28fc2ebda565")}) node_id = 7 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106852024-12-20T22:25:47.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106862024-12-20T22:25:47.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106872024-12-20T22:25:47.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106882024-12-20T22:25:47.954ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106892024-12-20T22:25:47.954ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106902024-12-20T22:25:47.958ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106912024-12-20T22:25:47.958ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106922024-12-20T22:25:47.961ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106932024-12-20T22:25:47.961ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106942024-12-20T22:25:47.967ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 propolis_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
106952024-12-20T22:25:47.967ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ReleaseSledResources
106962024-12-20T22:25:47.967ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ReleaseSledResources
106972024-12-20T22:25:47.976ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
106982024-12-20T22:25:47.976ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
106992024-12-20T22:25:47.980ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107002024-12-20T22:25:47.980ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
107012024-12-20T22:25:47.983ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 propolis_id = 0b768c17-53e3-4ff3-bbb7-28fc2ebda565 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
107022024-12-20T22:25:47.983ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = MarkVmmDeleted
107032024-12-20T22:25:47.983ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = MarkVmmDeleted
107042024-12-20T22:25:47.991ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107052024-12-20T22:25:47.991ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
107062024-12-20T22:25:47.994ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107072024-12-20T22:25:47.994ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
107082024-12-20T22:25:47.998ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107092024-12-20T22:25:47.998ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
107102024-12-20T22:25:48.001ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107112024-12-20T22:25:48.001ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
107122024-12-20T22:25:48.005ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ChainSuccessorSaga
107132024-12-20T22:25:48.005ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ChainSuccessorSaga
107142024-12-20T22:25:48.006ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ChainSuccessorSaga
107152024-12-20T22:25:48.006ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ChainSuccessorSaga
107162024-12-20T22:25:48.007ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ChainSuccessorSaga
107172024-12-20T22:25:48.008ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ChainSuccessorSaga
107182024-12-20T22:25:48.009ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ChainSuccessorSaga
107192024-12-20T22:25:48.013ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 79569914-721c-4af5-b3de-b3d4df7ef204, lookup_type: ById(79569914-721c-4af5-b3de-b3d4df7ef204) }, key: d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3, lookup_type: ById(d73ec2f8-e46b-4168-9fb7-4e6fcbad68b3) }, key: e0e12a47-30ee-446d-9cc5-4e57bdbf39c7, lookup_type: ById(e0e12a47-30ee-446d-9cc5-4e57bdbf39c7) } result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ChainSuccessorSaga
107202024-12-20T22:25:48.013ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ChainSuccessorSaga
107212024-12-20T22:25:48.013ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_node = ChainSuccessorSaga
107222024-12-20T22:25:48.029ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update
107232024-12-20T22:25:48.029ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107242024-12-20T22:25:48.029ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
107252024-12-20T22:25:48.029ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Signaled
107262024-12-20T22:25:48.029ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
107272024-12-20T22:25:48.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107282024-12-20T22:25:48.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107292024-12-20T22:25:48.033ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107302024-12-20T22:25:48.033ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
107312024-12-20T22:25:48.036ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107322024-12-20T22:25:48.036ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
107332024-12-20T22:25:48.040ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107342024-12-20T22:25:48.040ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5
107352024-12-20T22:25:48.042ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
107362024-12-20T22:25:48.042ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107372024-12-20T22:25:48.042ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b86eb4d-8257-4092-bbb9-8f679c33c9dd", "content-length": "372", "date": "Fri, 20 Dec 2024 22:25:48 GMT"} })
107382024-12-20T22:25:48.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107392024-12-20T22:25:48.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107402024-12-20T22:25:48.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107412024-12-20T22:25:48.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107422024-12-20T22:25:48.058ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107432024-12-20T22:25:48.058ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
107442024-12-20T22:25:48.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107452024-12-20T22:25:48.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107462024-12-20T22:25:48.061ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107472024-12-20T22:25:48.061ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107482024-12-20T22:25:48.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107492024-12-20T22:25:48.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107502024-12-20T22:25:48.063ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107512024-12-20T22:25:48.063ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107522024-12-20T22:25:48.063ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 34.261955ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107532024-12-20T22:25:48.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 9747fa09-3b6c-486c-a9ad-b84dfabfeb51 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
107542024-12-20T22:25:48.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 9747fa09-3b6c-486c-a9ad-b84dfabfeb51 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
107552024-12-20T22:25:48.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 9747fa09-3b6c-486c-a9ad-b84dfabfeb51 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
107562024-12-20T22:25:48.073ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107572024-12-20T22:25:48.074ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 saga_name = instance-update saga_result = SagaResult { saga_id: b092c828-10f5-44e5-9e1b-3c11a68daba5, saga_log: SagaLog { saga_id: b092c828-10f5-44e5-9e1b-3c11a68daba5, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("522f27ca-4001-4559-b605-2e284cc9f210")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("522f27ca-4001-4559-b605-2e284cc9f210")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("e0e12a47-30ee-446d-9cc5-4e57bdbf39c7"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0b768c17-53e3-4ff3-bbb7-28fc2ebda565")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("e0e12a47-30ee-446d-9cc5-4e57bdbf39c7"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0b768c17-53e3-4ff3-bbb7-28fc2ebda565")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("522f27ca-4001-4559-b605-2e284cc9f210"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("522f27ca-4001-4559-b605-2e284cc9f210")}} }) }
107582024-12-20T22:25:48.074ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = b092c828-10f5-44e5-9e1b-3c11a68daba5 instance_id = e0e12a47-30ee-446d-9cc5-4e57bdbf39c7 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update
107592024-12-20T22:25:48.074ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107602024-12-20T22:25:48.074ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
107612024-12-20T22:25:48.077ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107622024-12-20T22:25:48.077ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
107632024-12-20T22:25:48.081ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107642024-12-20T22:25:48.081ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
107652024-12-20T22:25:48.082ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
107662024-12-20T22:25:48.082ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
107672024-12-20T22:25:48.082ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bce8c272-11f6-4a1f-8f8d-fdd7ade6d662", "date": "Fri, 20 Dec 2024 22:25:48 GMT"} })
107682024-12-20T22:25:48.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107692024-12-20T22:25:48.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107702024-12-20T22:25:48.084ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107712024-12-20T22:25:48.084ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b
107722024-12-20T22:25:48.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107732024-12-20T22:25:48.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107742024-12-20T22:25:48.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107752024-12-20T22:25:48.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107762024-12-20T22:25:48.091ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update sec_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
107772024-12-20T22:25:48.091ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 98ded834-ddc5-4a0c-9adf-a3ce156ad68b saga_name = start-instance-update saga_result = SagaResult { saga_id: 98ded834-ddc5-4a0c-9adf-a3ce156ad68b, saga_log: SagaLog { saga_id: 98ded834-ddc5-4a0c-9adf-a3ce156ad68b, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("8c7cb4c3-ebb8-40af-ad87-dac3523e9958")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("8c7cb4c3-ebb8-40af-ad87-dac3523e9958")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("8c7cb4c3-ebb8-40af-ad87-dac3523e9958"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("8c7cb4c3-ebb8-40af-ad87-dac3523e9958")}} }) }
107782024-12-20T22:25:48.091ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107792024-12-20T22:25:48.091ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107802024-12-20T22:25:48.092ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "499f144d-793c-45e4-a7f0-445b31a8d88f", "date": "Fri, 20 Dec 2024 22:25:48 GMT"} })
107812024-12-20T22:25:48.094ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 149.547535ms iteration = 26 status = {}
107822024-12-20T22:25:48.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107832024-12-20T22:25:48.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107842024-12-20T22:25:48.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107852024-12-20T22:25:48.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107862024-12-20T22:25:48.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107872024-12-20T22:25:48.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107882024-12-20T22:25:48.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107892024-12-20T22:25:48.145ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107902024-12-20T22:25:48.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107912024-12-20T22:25:48.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107922024-12-20T22:25:48.230ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
107932024-12-20T22:25:48.230ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c9cbbbd-92cb-4539-9c65-27110afe687e", "content-length": "691", "date": "Fri, 20 Dec 2024 22:25:48 GMT"} })
107942024-12-20T22:25:48.230ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
107952024-12-20T22:25:48.230ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
107962024-12-20T22:25:48.230ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
107972024-12-20T22:25:48.231ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 287.144859ms iteration = 25 status = {}
107982024-12-20T22:25:48.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bda177fa-bf4d-4f86-832b-23130d2cec98 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
107992024-12-20T22:25:48.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bda177fa-bf4d-4f86-832b-23130d2cec98 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108002024-12-20T22:25:48.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bda177fa-bf4d-4f86-832b-23130d2cec98 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108012024-12-20T22:25:49.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3f122df4-c2da-483c-a2e7-6800192b76b3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108022024-12-20T22:25:49.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3f122df4-c2da-483c-a2e7-6800192b76b3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108032024-12-20T22:25:49.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3f122df4-c2da-483c-a2e7-6800192b76b3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108042024-12-20T22:25:50.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e6f2f85d-b1ee-44f2-8ede-65ed0a8c5973 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108052024-12-20T22:25:50.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e6f2f85d-b1ee-44f2-8ede-65ed0a8c5973 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108062024-12-20T22:25:50.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e6f2f85d-b1ee-44f2-8ede-65ed0a8c5973 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108072024-12-20T22:25:51.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba92af6d-2575-4a37-8310-5bf98eacaea7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108082024-12-20T22:25:51.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba92af6d-2575-4a37-8310-5bf98eacaea7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108092024-12-20T22:25:51.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba92af6d-2575-4a37-8310-5bf98eacaea7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108102024-12-20T22:25:52.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e7131c69-d331-476c-bb58-43ed159bd75a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108112024-12-20T22:25:52.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e7131c69-d331-476c-bb58-43ed159bd75a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108122024-12-20T22:25:52.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e7131c69-d331-476c-bb58-43ed159bd75a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108132024-12-20T22:25:53.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
108142024-12-20T22:25:53.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
108152024-12-20T22:25:53.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108162024-12-20T22:25:53.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108172024-12-20T22:25:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108182024-12-20T22:25:53.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108192024-12-20T22:25:53.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108202024-12-20T22:25:53.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108212024-12-20T22:25:53.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108222024-12-20T22:25:53.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108232024-12-20T22:25:53.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108242024-12-20T22:25:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108252024-12-20T22:25:53.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108262024-12-20T22:25:53.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
108272024-12-20T22:25:53.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108282024-12-20T22:25:53.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108292024-12-20T22:25:53.468ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
108302024-12-20T22:25:53.468ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.341125ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
108312024-12-20T22:25:53.474ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108322024-12-20T22:25:53.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108332024-12-20T22:25:53.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.886404ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108342024-12-20T22:25:53.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa902c16-7944-4ff3-9331-9e081873ad65 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108352024-12-20T22:25:53.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa902c16-7944-4ff3-9331-9e081873ad65 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108362024-12-20T22:25:53.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa902c16-7944-4ff3-9331-9e081873ad65 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108372024-12-20T22:25:54.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b947ee68-e720-4940-a8c3-2c8be5331ec5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108382024-12-20T22:25:54.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b947ee68-e720-4940-a8c3-2c8be5331ec5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108392024-12-20T22:25:54.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b947ee68-e720-4940-a8c3-2c8be5331ec5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108402024-12-20T22:25:55.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1536 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 2f3281ef-574b-4749-a2b8-2716854dbb8c response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
108412024-12-20T22:25:55.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63357af5-e314-43cb-a35b-0c2e1f0a0fc3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108422024-12-20T22:25:55.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63357af5-e314-43cb-a35b-0c2e1f0a0fc3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108432024-12-20T22:25:55.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 63357af5-e314-43cb-a35b-0c2e1f0a0fc3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108442024-12-20T22:25:57.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c90d201a-153b-4d9a-a358-83783a04f928 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108452024-12-20T22:25:57.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c90d201a-153b-4d9a-a358-83783a04f928 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108462024-12-20T22:25:57.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c90d201a-153b-4d9a-a358-83783a04f928 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108472024-12-20T22:25:58.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7255293f-0bf4-4156-bb8c-0bf9501f3076 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108482024-12-20T22:25:58.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7255293f-0bf4-4156-bb8c-0bf9501f3076 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108492024-12-20T22:25:58.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7255293f-0bf4-4156-bb8c-0bf9501f3076 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108502024-12-20T22:25:59.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c29ecbd-dda7-4f68-863b-ebca676a3447 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108512024-12-20T22:25:59.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c29ecbd-dda7-4f68-863b-ebca676a3447 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108522024-12-20T22:25:59.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c29ecbd-dda7-4f68-863b-ebca676a3447 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108532024-12-20T22:26:00.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a850cefc-fef7-40e4-a1d9-49fae511256c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108542024-12-20T22:26:00.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a850cefc-fef7-40e4-a1d9-49fae511256c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108552024-12-20T22:26:00.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a850cefc-fef7-40e4-a1d9-49fae511256c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108562024-12-20T22:26:01.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4e5589f2-4f54-472e-ad15-846ff72492cf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108572024-12-20T22:26:01.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4e5589f2-4f54-472e-ad15-846ff72492cf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108582024-12-20T22:26:01.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4e5589f2-4f54-472e-ad15-846ff72492cf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108592024-12-20T22:26:02.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 49e69135-e8f3-4c3f-8ba6-a90793ef936e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108602024-12-20T22:26:02.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 49e69135-e8f3-4c3f-8ba6-a90793ef936e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108612024-12-20T22:26:02.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 49e69135-e8f3-4c3f-8ba6-a90793ef936e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108622024-12-20T22:26:03.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1765e4ac-f2d0-4fac-a735-743f0211bfd3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108632024-12-20T22:26:03.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1765e4ac-f2d0-4fac-a735-743f0211bfd3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108642024-12-20T22:26:03.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1765e4ac-f2d0-4fac-a735-743f0211bfd3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108652024-12-20T22:26:03.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
108662024-12-20T22:26:03.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
108672024-12-20T22:26:03.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108682024-12-20T22:26:03.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108692024-12-20T22:26:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108702024-12-20T22:26:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108712024-12-20T22:26:03.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108722024-12-20T22:26:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108732024-12-20T22:26:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108742024-12-20T22:26:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108752024-12-20T22:26:03.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108762024-12-20T22:26:03.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108772024-12-20T22:26:03.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108782024-12-20T22:26:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
108792024-12-20T22:26:03.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108802024-12-20T22:26:03.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108812024-12-20T22:26:03.468ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
108822024-12-20T22:26:03.468ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.495287ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
108832024-12-20T22:26:03.481ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108842024-12-20T22:26:03.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108852024-12-20T22:26:03.482ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.74316ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108862024-12-20T22:26:04.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cd6f9d20-0b5c-4976-ac00-731981534734 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108872024-12-20T22:26:04.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cd6f9d20-0b5c-4976-ac00-731981534734 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108882024-12-20T22:26:04.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cd6f9d20-0b5c-4976-ac00-731981534734 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108892024-12-20T22:26:05.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8e863fe-805b-4dd5-b252-a610c091c05b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108902024-12-20T22:26:05.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8e863fe-805b-4dd5-b252-a610c091c05b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108912024-12-20T22:26:05.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8e863fe-805b-4dd5-b252-a610c091c05b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108922024-12-20T22:26:05.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = b8360243-fe22-4f08-93a9-996b0999caa1 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
108932024-12-20T22:26:06.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c1f661d7-17e3-4986-a6e5-84a0af5e0e3d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108942024-12-20T22:26:06.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c1f661d7-17e3-4986-a6e5-84a0af5e0e3d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108952024-12-20T22:26:06.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c1f661d7-17e3-4986-a6e5-84a0af5e0e3d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108962024-12-20T22:26:07.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 53ea2757-7949-478d-bf35-9dd84c675a2b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108972024-12-20T22:26:07.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 53ea2757-7949-478d-bf35-9dd84c675a2b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108982024-12-20T22:26:07.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 53ea2757-7949-478d-bf35-9dd84c675a2b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
108992024-12-20T22:26:08.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = df9157a4-5340-484f-81fb-4c6a0b9cd2b5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109002024-12-20T22:26:08.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = df9157a4-5340-484f-81fb-4c6a0b9cd2b5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109012024-12-20T22:26:08.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = df9157a4-5340-484f-81fb-4c6a0b9cd2b5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109022024-12-20T22:26:09.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6dfd166d-ea8c-4b0f-b2b7-42065707ae0c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109032024-12-20T22:26:09.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6dfd166d-ea8c-4b0f-b2b7-42065707ae0c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109042024-12-20T22:26:09.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6dfd166d-ea8c-4b0f-b2b7-42065707ae0c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109052024-12-20T22:26:10.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b101bff7-ac3e-43bf-bede-7272648ddd62 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109062024-12-20T22:26:10.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b101bff7-ac3e-43bf-bede-7272648ddd62 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109072024-12-20T22:26:10.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b101bff7-ac3e-43bf-bede-7272648ddd62 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109082024-12-20T22:26:10.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 777e7bbf-adcd-4403-a137-649506af2ccc roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
109092024-12-20T22:26:10.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 777e7bbf-adcd-4403-a137-649506af2ccc resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
109102024-12-20T22:26:10.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 777e7bbf-adcd-4403-a137-649506af2ccc response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
109112024-12-20T22:26:10.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 86d0a573-cd35-45c9-a472-58cec1bf6f5b roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
109122024-12-20T22:26:10.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 86d0a573-cd35-45c9-a472-58cec1bf6f5b resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
109132024-12-20T22:26:10.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 86d0a573-cd35-45c9-a472-58cec1bf6f5b response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
109142024-12-20T22:26:11.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c79da8b2-ad12-4db5-bb03-bc591de21e2b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109152024-12-20T22:26:11.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c79da8b2-ad12-4db5-bb03-bc591de21e2b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109162024-12-20T22:26:11.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c79da8b2-ad12-4db5-bb03-bc591de21e2b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109172024-12-20T22:26:12.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c9314bf-0f36-45c9-9af3-74286c5b43b8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109182024-12-20T22:26:12.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c9314bf-0f36-45c9-9af3-74286c5b43b8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109192024-12-20T22:26:12.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4c9314bf-0f36-45c9-9af3-74286c5b43b8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109202024-12-20T22:26:13.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b61d42d9-b956-4482-9559-2d2f93239076 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109212024-12-20T22:26:13.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b61d42d9-b956-4482-9559-2d2f93239076 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109222024-12-20T22:26:13.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b61d42d9-b956-4482-9559-2d2f93239076 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
109232024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
109242024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
109252024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
109262024-12-20T22:26:13.444ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
109272024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109282024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109292024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
109302024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
109312024-12-20T22:26:13.444ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
109322024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.781\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
109332024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
109342024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109352024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
109362024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109372024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
109382024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109392024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
109402024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
109412024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109422024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
109432024-12-20T22:26:13.444ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:16:13.444724363 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
109442024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
109452024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
109462024-12-20T22:26:13.444ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
109472024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
109482024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
109492024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109502024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
109512024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
109522024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109532024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
109542024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109552024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
109562024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
109572024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
109582024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
109592024-12-20T22:26:13.444ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109602024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
109612024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
109622024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
109632024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109642024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
109652024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
109662024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
109672024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
109682024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109692024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
109702024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
109712024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
109722024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
109732024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109742024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109752024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
109762024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
109772024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
109782024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
109792024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
109802024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
109812024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109822024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
109832024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
109842024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109852024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
109862024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109872024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109882024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109892024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109902024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109912024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109922024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109932024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109942024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
109952024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
109962024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109972024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
109982024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
109992024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
110002024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110012024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
110022024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110032024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110042024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110052024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
110062024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
110072024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110082024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110092024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110102024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110112024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110122024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110132024-12-20T22:26:13.445ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1600, tv_nsec: 370719920 } })
110142024-12-20T22:26:13.445ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1600, tv_nsec: 370760131 } })
110152024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110162024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110172024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110182024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110192024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
110202024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 935.979\u{b5}s iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
110212024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110222024-12-20T22:26:13.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110232024-12-20T22:26:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110242024-12-20T22:26:13.446ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
110252024-12-20T22:26:13.446ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.345453ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
110262024-12-20T22:26:13.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110272024-12-20T22:26:13.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110282024-12-20T22:26:13.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110292024-12-20T22:26:13.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110302024-12-20T22:26:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110312024-12-20T22:26:13.449ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.808599ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
110322024-12-20T22:26:13.449ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1600, tv_nsec: 375120715 } })
110332024-12-20T22:26:13.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
110342024-12-20T22:26:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
110352024-12-20T22:26:13.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110362024-12-20T22:26:13.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110372024-12-20T22:26:13.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110382024-12-20T22:26:13.453ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110392024-12-20T22:26:13.454ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:16:13.444724363 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
110402024-12-20T22:26:13.454ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.984101ms iteration = 13 status = {"expiration":"2024-12-20T22:16:13.444724363Z","pruned":[]}
110412024-12-20T22:26:13.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1600, tv_nsec: 380884033 } })
110422024-12-20T22:26:13.456ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
110432024-12-20T22:26:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110442024-12-20T22:26:13.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110452024-12-20T22:26:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
110462024-12-20T22:26:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110472024-12-20T22:26:13.456ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110482024-12-20T22:26:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110492024-12-20T22:26:13.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110502024-12-20T22:26:13.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110512024-12-20T22:26:13.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110522024-12-20T22:26:13.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110532024-12-20T22:26:13.461ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.333764ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
110542024-12-20T22:26:13.513ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110552024-12-20T22:26:13.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110562024-12-20T22:26:13.513ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110572024-12-20T22:26:13.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110582024-12-20T22:26:13.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.722192ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
110592024-12-20T22:26:13.517ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110602024-12-20T22:26:13.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
110612024-12-20T22:26:13.520ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110622024-12-20T22:26:13.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110632024-12-20T22:26:13.521ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110642024-12-20T22:26:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110652024-12-20T22:26:13.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110662024-12-20T22:26:13.522ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110672024-12-20T22:26:13.522ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
110682024-12-20T22:26:13.522ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
110692024-12-20T22:26:13.522ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.815623ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
110702024-12-20T22:26:13.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110712024-12-20T22:26:13.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110722024-12-20T22:26:13.525ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
110732024-12-20T22:26:13.525ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110742024-12-20T22:26:13.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110752024-12-20T22:26:13.525ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110762024-12-20T22:26:13.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
110772024-12-20T22:26:13.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110782024-12-20T22:26:13.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110792024-12-20T22:26:13.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
110802024-12-20T22:26:13.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110812024-12-20T22:26:13.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110822024-12-20T22:26:13.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110832024-12-20T22:26:13.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110842024-12-20T22:26:13.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.100847ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
110852024-12-20T22:26:13.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110862024-12-20T22:26:13.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110872024-12-20T22:26:13.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110882024-12-20T22:26:13.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
110892024-12-20T22:26:13.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110902024-12-20T22:26:13.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
110912024-12-20T22:26:13.532ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110922024-12-20T22:26:13.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110932024-12-20T22:26:13.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110942024-12-20T22:26:13.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110952024-12-20T22:26:13.532ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110962024-12-20T22:26:13.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110972024-12-20T22:26:13.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110982024-12-20T22:26:13.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110992024-12-20T22:26:13.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111002024-12-20T22:26:13.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111012024-12-20T22:26:13.535ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111022024-12-20T22:26:13.535ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
111032024-12-20T22:26:13.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111042024-12-20T22:26:13.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111052024-12-20T22:26:13.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111062024-12-20T22:26:13.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
111072024-12-20T22:26:13.536ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
111082024-12-20T22:26:13.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
111092024-12-20T22:26:13.536ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111102024-12-20T22:26:13.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
111112024-12-20T22:26:13.539ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
111122024-12-20T22:26:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
111132024-12-20T22:26:13.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111142024-12-20T22:26:13.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111152024-12-20T22:26:13.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111162024-12-20T22:26:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111172024-12-20T22:26:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111182024-12-20T22:26:13.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1600, tv_nsec: 470039640 } })
111192024-12-20T22:26:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
111202024-12-20T22:26:13.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111212024-12-20T22:26:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111222024-12-20T22:26:13.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
111232024-12-20T22:26:13.547ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111242024-12-20T22:26:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111252024-12-20T22:26:13.548ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 103.572403ms iteration = 6 status = {"nsuccess":5}
111262024-12-20T22:26:13.548ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111272024-12-20T22:26:13.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111282024-12-20T22:26:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111292024-12-20T22:26:13.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111302024-12-20T22:26:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111312024-12-20T22:26:13.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
111322024-12-20T22:26:13.554ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111332024-12-20T22:26:13.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111342024-12-20T22:26:13.558ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
111352024-12-20T22:26:13.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.208789ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
111362024-12-20T22:26:13.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
111372024-12-20T22:26:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111382024-12-20T22:26:13.563ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
111392024-12-20T22:26:13.563ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.794516ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
111402024-12-20T22:26:13.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 127.287241ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111412024-12-20T22:26:13.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111422024-12-20T22:26:13.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111432024-12-20T22:26:13.581ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
111442024-12-20T22:26:13.581ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
111452024-12-20T22:26:13.581ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
111462024-12-20T22:26:13.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111472024-12-20T22:26:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111482024-12-20T22:26:13.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111492024-12-20T22:26:13.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111502024-12-20T22:26:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111512024-12-20T22:26:13.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111522024-12-20T22:26:13.587ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
111532024-12-20T22:26:13.587ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
111542024-12-20T22:26:13.587ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 143.158221ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
111552024-12-20T22:26:13.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111562024-12-20T22:26:13.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 146.364633ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111572024-12-20T22:26:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111582024-12-20T22:26:13.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111592024-12-20T22:26:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111602024-12-20T22:26:13.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111612024-12-20T22:26:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111622024-12-20T22:26:13.598ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
111632024-12-20T22:26:13.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 154.704797ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111642024-12-20T22:26:13.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111652024-12-20T22:26:13.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111662024-12-20T22:26:13.600ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111672024-12-20T22:26:13.600ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111682024-12-20T22:26:13.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111692024-12-20T22:26:13.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111702024-12-20T22:26:13.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111712024-12-20T22:26:13.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 160.131121ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
111722024-12-20T22:26:13.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
111732024-12-20T22:26:13.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111742024-12-20T22:26:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111752024-12-20T22:26:13.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111762024-12-20T22:26:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111772024-12-20T22:26:13.608ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 163.482185ms iteration = 25 status = 0
111782024-12-20T22:26:13.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111792024-12-20T22:26:13.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
111802024-12-20T22:26:13.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111812024-12-20T22:26:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111822024-12-20T22:26:13.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111832024-12-20T22:26:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111842024-12-20T22:26:13.623ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
111852024-12-20T22:26:13.623ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
111862024-12-20T22:26:13.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111872024-12-20T22:26:13.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111882024-12-20T22:26:13.624ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
111892024-12-20T22:26:13.624ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
111902024-12-20T22:26:13.624ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
111912024-12-20T22:26:13.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111922024-12-20T22:26:13.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111932024-12-20T22:26:13.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111942024-12-20T22:26:13.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111952024-12-20T22:26:13.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111962024-12-20T22:26:13.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111972024-12-20T22:26:13.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111982024-12-20T22:26:13.629ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
111992024-12-20T22:26:13.629ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112002024-12-20T22:26:13.630ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b78eda4-14b8-462f-b8bf-8979ee61eae2", "content-length": "26", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
112012024-12-20T22:26:13.630ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112022024-12-20T22:26:13.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112032024-12-20T22:26:13.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112042024-12-20T22:26:13.630ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
112052024-12-20T22:26:13.630ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
112062024-12-20T22:26:13.630ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
112072024-12-20T22:26:13.630ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 185.929461ms iteration = 14 status = {"generation":1}
112082024-12-20T22:26:13.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112092024-12-20T22:26:13.631ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112102024-12-20T22:26:13.641ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112112024-12-20T22:26:13.641ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
112122024-12-20T22:26:13.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 196.318806ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
112132024-12-20T22:26:13.647ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
112142024-12-20T22:26:13.647ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 202.289566ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
112152024-12-20T22:26:13.658ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
112162024-12-20T22:26:13.658ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 213.723521ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
112172024-12-20T22:26:13.678ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 233.802503ms iteration = 29 status = {"physical_disks_added":0}
112182024-12-20T22:26:13.694ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
112192024-12-20T22:26:13.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112202024-12-20T22:26:13.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112212024-12-20T22:26:13.729ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
112222024-12-20T22:26:13.729ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112232024-12-20T22:26:13.729ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "299b524b-52df-46e4-9d7b-1fd092151e0d", "content-length": "26", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
112242024-12-20T22:26:13.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112252024-12-20T22:26:13.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
112262024-12-20T22:26:13.734ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
112272024-12-20T22:26:13.734ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112282024-12-20T22:26:13.734ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcce782f-e080-4328-896e-5b4559d037cd", "content-length": "26", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
112292024-12-20T22:26:13.734ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112302024-12-20T22:26:13.736ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112312024-12-20T22:26:13.801ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
112322024-12-20T22:26:13.802ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "662c2318-c472-48b5-82ea-8049471e806c", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
112332024-12-20T22:26:13.802ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
112342024-12-20T22:26:13.804ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "407c6f25-2eb7-4ed9-a42c-aa633a885c3e", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
112352024-12-20T22:26:13.804ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
112362024-12-20T22:26:13.806ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
112372024-12-20T22:26:13.806ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 361.825142ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
112382024-12-20T22:26:13.808ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
112392024-12-20T22:26:13.808ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112402024-12-20T22:26:13.809ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "870bb30d-e886-41e6-a964-13f7b65f29dc", "content-length": "372", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
112412024-12-20T22:26:13.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112422024-12-20T22:26:13.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112432024-12-20T22:26:13.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112442024-12-20T22:26:13.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112452024-12-20T22:26:13.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112462024-12-20T22:26:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112472024-12-20T22:26:13.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112482024-12-20T22:26:13.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112492024-12-20T22:26:13.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112502024-12-20T22:26:13.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112512024-12-20T22:26:13.830ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
112522024-12-20T22:26:13.830ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dd3c547-f929-4bd5-951b-df4a57117300", "content-length": "2", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
112532024-12-20T22:26:13.835ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112542024-12-20T22:26:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112552024-12-20T22:26:13.838ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 394.207208ms iteration = 25 status = null
112562024-12-20T22:26:13.871ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
112572024-12-20T22:26:13.871ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
112582024-12-20T22:26:13.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112592024-12-20T22:26:13.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112602024-12-20T22:26:13.883ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
112612024-12-20T22:26:13.895ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
112622024-12-20T22:26:13.895ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
112632024-12-20T22:26:13.895ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "41499acc-5432-4ceb-a418-f1b567dd5ba0", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
112642024-12-20T22:26:13.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112652024-12-20T22:26:13.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112662024-12-20T22:26:13.896ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 451.724036ms iteration = 25 status = {}
112672024-12-20T22:26:13.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112682024-12-20T22:26:13.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112692024-12-20T22:26:13.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112702024-12-20T22:26:13.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112712024-12-20T22:26:13.907ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
112722024-12-20T22:26:13.907ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112732024-12-20T22:26:13.908ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d3c8de5a-3b4d-4c88-8376-82c56ab74d83", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
112742024-12-20T22:26:13.910ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 465.522435ms iteration = 27 status = {}
112752024-12-20T22:26:13.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112762024-12-20T22:26:13.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112772024-12-20T22:26:13.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112782024-12-20T22:26:13.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112792024-12-20T22:26:13.933ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
112802024-12-20T22:26:13.933ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
112812024-12-20T22:26:13.933ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
112822024-12-20T22:26:13.933ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 488.707969ms iteration = 14 status = {"generation":2}
112832024-12-20T22:26:13.971ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
112842024-12-20T22:26:13.972ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0f7ba3b2-f47a-4017-b2b8-38f9b4627293", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
112852024-12-20T22:26:13.972ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
112862024-12-20T22:26:13.973ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7b84fccf-4faf-44fe-b877-49714194077f", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
112872024-12-20T22:26:13.973ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
112882024-12-20T22:26:13.975ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8f54f8ab-6e61-4141-96a5-5a4629df929d", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
112892024-12-20T22:26:13.975ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
112902024-12-20T22:26:13.977ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
112912024-12-20T22:26:13.977ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 532.60405ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
112922024-12-20T22:26:14.070ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
112932024-12-20T22:26:14.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112942024-12-20T22:26:14.087ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "726ffde6-9ea1-4b45-b40d-53697beae0b2", "content-length": "691", "date": "Fri, 20 Dec 2024 22:26:14 GMT"} })
112952024-12-20T22:26:14.087ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
112962024-12-20T22:26:14.087ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
112972024-12-20T22:26:14.087ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
112982024-12-20T22:26:14.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112992024-12-20T22:26:14.088ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 644.335614ms iteration = 26 status = {}
113002024-12-20T22:26:14.090ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
113012024-12-20T22:26:14.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113022024-12-20T22:26:14.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113032024-12-20T22:26:14.101ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
113042024-12-20T22:26:14.102ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "46662b78-2363-4da7-9d20-0b224b95d779", "content-length": "134", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
113052024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
113062024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
113072024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
113082024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
113092024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113102024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113112024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113122024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113132024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113142024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113152024-12-20T22:26:14.102ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
113162024-12-20T22:26:14.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113172024-12-20T22:26:14.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113182024-12-20T22:26:14.107ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
113192024-12-20T22:26:14.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d16d4952-cff6-4821-8eda-dacc0596583b", "content-length": "2", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
113202024-12-20T22:26:14.108ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
113212024-12-20T22:26:14.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "87c0475a-0888-49b6-bb53-20c4ed1ba5dc", "content-length": "52", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
113222024-12-20T22:26:14.108ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
113232024-12-20T22:26:14.108ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
113242024-12-20T22:26:14.200ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2741cf15-8553-4833-a9ea-e7853180c55f", "date": "Fri, 20 Dec 2024 22:26:13 GMT"} })
113252024-12-20T22:26:14.200ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
113262024-12-20T22:26:14.200ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
113272024-12-20T22:26:14.201ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5ea9529-9dae-4dfc-b218-3cc91f3d61f1", "content-length": "682", "date": "Fri, 20 Dec 2024 22:26:14 GMT"} })
113282024-12-20T22:26:14.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113292024-12-20T22:26:14.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113302024-12-20T22:26:14.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113312024-12-20T22:26:14.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113322024-12-20T22:26:14.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113332024-12-20T22:26:14.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113342024-12-20T22:26:14.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113352024-12-20T22:26:14.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113362024-12-20T22:26:14.216ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 771.832658ms iteration = 25 status = {}
113372024-12-20T22:26:14.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b7ffa789-00a2-4ebb-b6df-1294e2035ff2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113382024-12-20T22:26:14.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b7ffa789-00a2-4ebb-b6df-1294e2035ff2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113392024-12-20T22:26:14.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b7ffa789-00a2-4ebb-b6df-1294e2035ff2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113402024-12-20T22:26:15.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 83940335-c679-4b50-9479-9ba5a088e524 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113412024-12-20T22:26:15.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 83940335-c679-4b50-9479-9ba5a088e524 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113422024-12-20T22:26:15.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 83940335-c679-4b50-9479-9ba5a088e524 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113432024-12-20T22:26:15.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1365 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = bc4cb123-ced1-4c10-b9eb-51be43f9120c response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
113442024-12-20T22:26:16.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d979fafa-f6ab-40e9-a484-3cddb4b7d45d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113452024-12-20T22:26:16.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d979fafa-f6ab-40e9-a484-3cddb4b7d45d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113462024-12-20T22:26:16.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d979fafa-f6ab-40e9-a484-3cddb4b7d45d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113472024-12-20T22:26:17.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ce1592d6-d501-43f9-bed8-4e29cceb540d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113482024-12-20T22:26:17.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ce1592d6-d501-43f9-bed8-4e29cceb540d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113492024-12-20T22:26:17.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ce1592d6-d501-43f9-bed8-4e29cceb540d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113502024-12-20T22:26:18.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = de5d0501-5f7e-4ec0-911f-f7858b3076c5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
113512024-12-20T22:26:18.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = de5d0501-5f7e-4ec0-911f-f7858b3076c5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
113522024-12-20T22:26:18.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = de5d0501-5f7e-4ec0-911f-f7858b3076c5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
113532024-12-20T22:26:18.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 52684eb1-0b76-4aaa-a56d-dc0d67778049 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113542024-12-20T22:26:18.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 52684eb1-0b76-4aaa-a56d-dc0d67778049 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113552024-12-20T22:26:18.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 52684eb1-0b76-4aaa-a56d-dc0d67778049 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113562024-12-20T22:26:19.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa842566-fc73-4eea-9180-cc8a6b741d4d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113572024-12-20T22:26:19.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa842566-fc73-4eea-9180-cc8a6b741d4d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113582024-12-20T22:26:19.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = aa842566-fc73-4eea-9180-cc8a6b741d4d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113592024-12-20T22:26:20.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e9ac1cf1-aea2-4427-9783-a6d38eb5c724 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113602024-12-20T22:26:20.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e9ac1cf1-aea2-4427-9783-a6d38eb5c724 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113612024-12-20T22:26:20.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e9ac1cf1-aea2-4427-9783-a6d38eb5c724 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113622024-12-20T22:26:21.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b55bfc44-ce1e-4f89-a19b-bd2cc857918f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113632024-12-20T22:26:21.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b55bfc44-ce1e-4f89-a19b-bd2cc857918f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113642024-12-20T22:26:21.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b55bfc44-ce1e-4f89-a19b-bd2cc857918f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113652024-12-20T22:26:22.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 085cb6f1-4e1b-4b26-971b-5a1eb768cafd roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113662024-12-20T22:26:22.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 085cb6f1-4e1b-4b26-971b-5a1eb768cafd resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113672024-12-20T22:26:22.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 085cb6f1-4e1b-4b26-971b-5a1eb768cafd response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113682024-12-20T22:26:23.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
113692024-12-20T22:26:23.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
113702024-12-20T22:26:23.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113712024-12-20T22:26:23.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113722024-12-20T22:26:23.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113732024-12-20T22:26:23.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113742024-12-20T22:26:23.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113752024-12-20T22:26:23.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113762024-12-20T22:26:23.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113772024-12-20T22:26:23.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113782024-12-20T22:26:23.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113792024-12-20T22:26:23.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113802024-12-20T22:26:23.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113812024-12-20T22:26:23.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
113822024-12-20T22:26:23.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113832024-12-20T22:26:23.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113842024-12-20T22:26:23.467ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
113852024-12-20T22:26:23.467ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.053082ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
113862024-12-20T22:26:23.474ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113872024-12-20T22:26:23.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113882024-12-20T22:26:23.503ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.289667ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113892024-12-20T22:26:23.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5b82a951-5995-40d2-b294-6c1668dcffbf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113902024-12-20T22:26:23.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5b82a951-5995-40d2-b294-6c1668dcffbf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113912024-12-20T22:26:23.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5b82a951-5995-40d2-b294-6c1668dcffbf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113922024-12-20T22:26:24.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f37b4743-62a7-4809-acd4-9f1441ad3889 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113932024-12-20T22:26:24.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f37b4743-62a7-4809-acd4-9f1441ad3889 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113942024-12-20T22:26:24.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f37b4743-62a7-4809-acd4-9f1441ad3889 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113952024-12-20T22:26:25.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c0bce61-63e7-4129-b2a8-38396174b3ab roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113962024-12-20T22:26:25.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c0bce61-63e7-4129-b2a8-38396174b3ab resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113972024-12-20T22:26:25.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9c0bce61-63e7-4129-b2a8-38396174b3ab response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
113982024-12-20T22:26:25.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1608 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 46d3db7f-434c-4231-b7f1-854e9b84cb09 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
113992024-12-20T22:26:26.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ed78c1c8-4024-4128-8f95-cff94305b69d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114002024-12-20T22:26:26.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ed78c1c8-4024-4128-8f95-cff94305b69d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114012024-12-20T22:26:26.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ed78c1c8-4024-4128-8f95-cff94305b69d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114022024-12-20T22:26:27.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d7f8024a-df76-499d-aefb-98869552ae4f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114032024-12-20T22:26:27.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d7f8024a-df76-499d-aefb-98869552ae4f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114042024-12-20T22:26:27.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d7f8024a-df76-499d-aefb-98869552ae4f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114052024-12-20T22:26:28.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f9e40cf2-acef-4508-a9a2-35a1b1c8239d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114062024-12-20T22:26:28.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f9e40cf2-acef-4508-a9a2-35a1b1c8239d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114072024-12-20T22:26:28.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f9e40cf2-acef-4508-a9a2-35a1b1c8239d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114082024-12-20T22:26:29.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7c974c1f-e20f-4176-a7a8-a55dc0707955 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114092024-12-20T22:26:29.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7c974c1f-e20f-4176-a7a8-a55dc0707955 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114102024-12-20T22:26:29.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7c974c1f-e20f-4176-a7a8-a55dc0707955 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114112024-12-20T22:26:30.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fdd51722-0b0d-48f0-889a-5db1192f9e74 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114122024-12-20T22:26:30.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fdd51722-0b0d-48f0-889a-5db1192f9e74 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114132024-12-20T22:26:30.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fdd51722-0b0d-48f0-889a-5db1192f9e74 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114142024-12-20T22:26:31.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c23cf5b7-a8e1-4afa-b2b5-5a1d370e1a8e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114152024-12-20T22:26:31.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c23cf5b7-a8e1-4afa-b2b5-5a1d370e1a8e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114162024-12-20T22:26:31.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c23cf5b7-a8e1-4afa-b2b5-5a1d370e1a8e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114172024-12-20T22:26:32.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2da651e-378d-479f-829e-6ee28e139361 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114182024-12-20T22:26:32.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2da651e-378d-479f-829e-6ee28e139361 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114192024-12-20T22:26:32.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2da651e-378d-479f-829e-6ee28e139361 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114202024-12-20T22:26:33.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
114212024-12-20T22:26:33.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
114222024-12-20T22:26:33.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114232024-12-20T22:26:33.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114242024-12-20T22:26:33.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114252024-12-20T22:26:33.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114262024-12-20T22:26:33.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114272024-12-20T22:26:33.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114282024-12-20T22:26:33.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114292024-12-20T22:26:33.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114302024-12-20T22:26:33.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114312024-12-20T22:26:33.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114322024-12-20T22:26:33.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114332024-12-20T22:26:33.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
114342024-12-20T22:26:33.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114352024-12-20T22:26:33.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114362024-12-20T22:26:33.468ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
114372024-12-20T22:26:33.468ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.519166ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
114382024-12-20T22:26:33.475ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114392024-12-20T22:26:33.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114402024-12-20T22:26:33.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.904061ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114412024-12-20T22:26:33.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 45d7acf5-3d8a-4caa-82eb-8c0d4a1bb4f3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114422024-12-20T22:26:33.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 45d7acf5-3d8a-4caa-82eb-8c0d4a1bb4f3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114432024-12-20T22:26:33.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 45d7acf5-3d8a-4caa-82eb-8c0d4a1bb4f3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114442024-12-20T22:26:34.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ef65a42c-fa60-432e-ab28-39f8c23b27f9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114452024-12-20T22:26:34.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ef65a42c-fa60-432e-ab28-39f8c23b27f9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114462024-12-20T22:26:34.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ef65a42c-fa60-432e-ab28-39f8c23b27f9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114472024-12-20T22:26:35.692ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1462 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 7dee61da-beb6-412b-931e-d80c9102595f response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
114482024-12-20T22:26:35.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2af19685-9a35-435e-bde7-0f2807091fb8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114492024-12-20T22:26:35.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2af19685-9a35-435e-bde7-0f2807091fb8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114502024-12-20T22:26:35.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2af19685-9a35-435e-bde7-0f2807091fb8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114512024-12-20T22:26:36.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8e041f57-a556-4db9-ab27-0057658e14fc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114522024-12-20T22:26:36.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8e041f57-a556-4db9-ab27-0057658e14fc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114532024-12-20T22:26:36.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8e041f57-a556-4db9-ab27-0057658e14fc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114542024-12-20T22:26:37.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f16e05f8-2658-4051-bb96-2f582011b440 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114552024-12-20T22:26:37.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f16e05f8-2658-4051-bb96-2f582011b440 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114562024-12-20T22:26:37.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f16e05f8-2658-4051-bb96-2f582011b440 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114572024-12-20T22:26:38.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 60574021-4ba6-4ce7-ab6d-cc7af9c70571 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114582024-12-20T22:26:38.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 60574021-4ba6-4ce7-ab6d-cc7af9c70571 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114592024-12-20T22:26:38.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 60574021-4ba6-4ce7-ab6d-cc7af9c70571 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114602024-12-20T22:26:39.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cb0a8c24-f24f-4118-9aa6-265a4adf44cf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114612024-12-20T22:26:39.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cb0a8c24-f24f-4118-9aa6-265a4adf44cf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114622024-12-20T22:26:39.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cb0a8c24-f24f-4118-9aa6-265a4adf44cf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114632024-12-20T22:26:40.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 1a7f13d8-a4de-4edb-8971-07a355fb2601 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
114642024-12-20T22:26:40.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 1a7f13d8-a4de-4edb-8971-07a355fb2601 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
114652024-12-20T22:26:40.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 1a7f13d8-a4de-4edb-8971-07a355fb2601 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
114662024-12-20T22:26:40.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = c48b23ce-57d2-4302-a397-31cdccc46b15 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
114672024-12-20T22:26:40.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = c48b23ce-57d2-4302-a397-31cdccc46b15 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
114682024-12-20T22:26:40.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = c48b23ce-57d2-4302-a397-31cdccc46b15 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
114692024-12-20T22:26:40.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c11d59f5-01c5-4b27-b3fb-b6ad63a52624 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114702024-12-20T22:26:40.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c11d59f5-01c5-4b27-b3fb-b6ad63a52624 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114712024-12-20T22:26:40.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c11d59f5-01c5-4b27-b3fb-b6ad63a52624 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114722024-12-20T22:26:41.477ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50948
114732024-12-20T22:26:41.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50948 req_id = 889a7d84-e3f6-489b-bf24-42214df6f498 roles = RoleSet { roles: {} } uri = /metrics/producers
114742024-12-20T22:26:41.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50948 req_id = 889a7d84-e3f6-489b-bf24-42214df6f498 resource = Database result = Ok(()) uri = /metrics/producers
114752024-12-20T22:26:41.513ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 409c06a2-2340-44a9-a04f-6817610bd642
114762024-12-20T22:26:41.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35625 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50948 req_id = 889a7d84-e3f6-489b-bf24-42214df6f498 response_code = 201 uri = /metrics/producers
114772024-12-20T22:26:41.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b6bb2feb-bfb6-402a-9b02-4114ff2506a4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114782024-12-20T22:26:41.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b6bb2feb-bfb6-402a-9b02-4114ff2506a4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114792024-12-20T22:26:41.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b6bb2feb-bfb6-402a-9b02-4114ff2506a4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114802024-12-20T22:26:42.473ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55146
114812024-12-20T22:26:42.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55146 req_id = 671cf931-8930-473d-b7d0-d98cd9774c0b roles = RoleSet { roles: {} } uri = /metrics/producers
114822024-12-20T22:26:42.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55146 req_id = 671cf931-8930-473d-b7d0-d98cd9774c0b resource = Database result = Ok(()) uri = /metrics/producers
114832024-12-20T22:26:42.512ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 1cf20796-1e8a-4632-b82f-1c78cae2c84a
114842024-12-20T22:26:42.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38873 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55146 req_id = 671cf931-8930-473d-b7d0-d98cd9774c0b response_code = 201 uri = /metrics/producers
114852024-12-20T22:26:42.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a47c4d51-8968-446c-80d7-eed85501d391 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114862024-12-20T22:26:42.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a47c4d51-8968-446c-80d7-eed85501d391 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114872024-12-20T22:26:42.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a47c4d51-8968-446c-80d7-eed85501d391 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
114882024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
114892024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
114902024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
114912024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114922024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114932024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
114942024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114952024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
114962024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
114972024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
114982024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114992024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115002024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
115012024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
115022024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115032024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
115042024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115052024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
115062024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
115072024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
115082024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
115092024-12-20T22:26:43.445ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
115102024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115112024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
115122024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115132024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
115142024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
115152024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
115162024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115172024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
115182024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
115192024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115202024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115212024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
115222024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
115232024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115242024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115252024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115262024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115272024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115282024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115292024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115302024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
115312024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115322024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115332024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115342024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115352024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115362024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
115372024-12-20T22:26:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115382024-12-20T22:26:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
115392024-12-20T22:26:43.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115402024-12-20T22:26:43.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115412024-12-20T22:26:43.449ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.343114ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
115422024-12-20T22:26:43.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
115432024-12-20T22:26:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
115442024-12-20T22:26:43.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
115452024-12-20T22:26:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115462024-12-20T22:26:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115472024-12-20T22:26:43.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
115482024-12-20T22:26:43.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115492024-12-20T22:26:43.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115502024-12-20T22:26:43.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115512024-12-20T22:26:43.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115522024-12-20T22:26:43.456ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1630, tv_nsec: 380959594 } })
115532024-12-20T22:26:43.456ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
115542024-12-20T22:26:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115552024-12-20T22:26:43.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115562024-12-20T22:26:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115572024-12-20T22:26:43.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115582024-12-20T22:26:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115592024-12-20T22:26:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115602024-12-20T22:26:43.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115612024-12-20T22:26:43.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
115622024-12-20T22:26:43.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115632024-12-20T22:26:43.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115642024-12-20T22:26:43.463ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1630, tv_nsec: 388548080 } })
115652024-12-20T22:26:43.464ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
115662024-12-20T22:26:43.465ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115672024-12-20T22:26:43.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115682024-12-20T22:26:43.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115692024-12-20T22:26:43.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115702024-12-20T22:26:43.471ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1630, tv_nsec: 396693332 } })
115712024-12-20T22:26:43.472ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115722024-12-20T22:26:43.472ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
115732024-12-20T22:26:43.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115742024-12-20T22:26:43.497ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115752024-12-20T22:26:43.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115762024-12-20T22:26:43.507ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115772024-12-20T22:26:43.507ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
115782024-12-20T22:26:43.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115792024-12-20T22:26:43.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115802024-12-20T22:26:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115812024-12-20T22:26:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115822024-12-20T22:26:43.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.050224ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
115832024-12-20T22:26:43.509ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.6412ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
115842024-12-20T22:26:43.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115852024-12-20T22:26:43.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115862024-12-20T22:26:43.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115872024-12-20T22:26:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115882024-12-20T22:26:43.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115892024-12-20T22:26:43.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.53665ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115902024-12-20T22:26:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
115912024-12-20T22:26:43.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115922024-12-20T22:26:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115932024-12-20T22:26:43.517ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
115942024-12-20T22:26:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115952024-12-20T22:26:43.520ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.173117ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
115962024-12-20T22:26:43.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115972024-12-20T22:26:43.526ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.733893ms iteration = 26 status = 0
115982024-12-20T22:26:43.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115992024-12-20T22:26:43.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116002024-12-20T22:26:43.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
116012024-12-20T22:26:43.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116022024-12-20T22:26:43.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116032024-12-20T22:26:43.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116042024-12-20T22:26:43.529ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
116052024-12-20T22:26:43.529ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116062024-12-20T22:26:43.529ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae481140-ccaa-4dc6-997b-8228f0459fe8", "content-length": "26", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
116072024-12-20T22:26:43.529ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116082024-12-20T22:26:43.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
116092024-12-20T22:26:43.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116102024-12-20T22:26:43.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116112024-12-20T22:26:43.531ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116122024-12-20T22:26:43.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116132024-12-20T22:26:43.535ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
116142024-12-20T22:26:43.535ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.632382ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
116152024-12-20T22:26:43.537ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116162024-12-20T22:26:43.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116172024-12-20T22:26:43.537ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116182024-12-20T22:26:43.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116192024-12-20T22:26:43.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116202024-12-20T22:26:43.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116212024-12-20T22:26:43.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116222024-12-20T22:26:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
116232024-12-20T22:26:43.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
116242024-12-20T22:26:43.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116252024-12-20T22:26:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116262024-12-20T22:26:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.188148ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
116272024-12-20T22:26:43.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116282024-12-20T22:26:43.545ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
116292024-12-20T22:26:43.545ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.729934ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
116302024-12-20T22:26:43.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
116312024-12-20T22:26:43.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116322024-12-20T22:26:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116332024-12-20T22:26:43.548ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116342024-12-20T22:26:43.548ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
116352024-12-20T22:26:43.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116362024-12-20T22:26:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116372024-12-20T22:26:43.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.350211ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
116382024-12-20T22:26:43.565ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
116392024-12-20T22:26:43.565ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116402024-12-20T22:26:43.565ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f7df228-86ad-45d8-a161-73e6c0b60444", "content-length": "26", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
116412024-12-20T22:26:43.565ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116422024-12-20T22:26:43.567ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
116432024-12-20T22:26:43.567ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
116442024-12-20T22:26:43.567ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116452024-12-20T22:26:43.567ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b20d8beb-bd4d-463c-b356-45b38a309692", "content-length": "26", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
116462024-12-20T22:26:43.567ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116472024-12-20T22:26:43.569ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116482024-12-20T22:26:43.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116492024-12-20T22:26:43.573ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.659794ms iteration = 30 status = {"physical_disks_added":0}
116502024-12-20T22:26:43.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
116512024-12-20T22:26:43.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116522024-12-20T22:26:43.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116532024-12-20T22:26:43.579ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116542024-12-20T22:26:43.579ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
116552024-12-20T22:26:43.579ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.569585ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
116562024-12-20T22:26:43.626ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
116572024-12-20T22:26:43.627ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a1f040f-d11d-4db9-94d5-804edb0fe78c", "content-length": "2", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
116582024-12-20T22:26:43.628ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116592024-12-20T22:26:43.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116602024-12-20T22:26:43.630ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 185.313155ms iteration = 26 status = null
116612024-12-20T22:26:43.639ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
116622024-12-20T22:26:43.640ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d75dd9b-44a5-4b33-9e1a-1c16a593549d", "content-length": "691", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
116632024-12-20T22:26:43.640ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
116642024-12-20T22:26:43.640ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
116652024-12-20T22:26:43.640ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
116662024-12-20T22:26:43.642ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 196.73923ms iteration = 27 status = {}
116672024-12-20T22:26:43.660ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 215.429168ms iteration = 26 status = {}
116682024-12-20T22:26:43.698ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
116692024-12-20T22:26:43.698ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116702024-12-20T22:26:43.698ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dc125e8-5260-4c83-a853-d1552efabfbc", "content-length": "372", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
116712024-12-20T22:26:43.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116722024-12-20T22:26:43.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116732024-12-20T22:26:43.713ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
116742024-12-20T22:26:43.713ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
116752024-12-20T22:26:43.713ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "14a76729-dd81-49be-98ef-9127f59bc439", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
116762024-12-20T22:26:43.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116772024-12-20T22:26:43.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116782024-12-20T22:26:43.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116792024-12-20T22:26:43.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116802024-12-20T22:26:43.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116812024-12-20T22:26:43.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116822024-12-20T22:26:43.722ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
116832024-12-20T22:26:43.722ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116842024-12-20T22:26:43.722ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "83bc2e1b-edfb-413d-a4c9-23ae434dc0aa", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
116852024-12-20T22:26:43.724ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 278.701865ms iteration = 28 status = {}
116862024-12-20T22:26:43.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116872024-12-20T22:26:43.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116882024-12-20T22:26:43.741ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
116892024-12-20T22:26:43.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116902024-12-20T22:26:43.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116912024-12-20T22:26:43.749ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
116922024-12-20T22:26:43.750ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d393248-9f27-4473-8585-94b1f28a3136", "content-length": "134", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
116932024-12-20T22:26:43.750ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
116942024-12-20T22:26:43.750ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
116952024-12-20T22:26:43.750ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
116962024-12-20T22:26:43.750ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
116972024-12-20T22:26:43.750ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116982024-12-20T22:26:43.750ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116992024-12-20T22:26:43.750ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117002024-12-20T22:26:43.750ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
117012024-12-20T22:26:43.750ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117022024-12-20T22:26:43.750ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
117032024-12-20T22:26:43.751ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
117042024-12-20T22:26:43.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117052024-12-20T22:26:43.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117062024-12-20T22:26:43.753ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
117072024-12-20T22:26:43.754ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "472782a8-6698-4c68-a90b-4bdf796f4ee5", "content-length": "2", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
117082024-12-20T22:26:43.754ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
117092024-12-20T22:26:43.754ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "57e1c37d-b463-45a1-a747-29f275b10216", "content-length": "52", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
117102024-12-20T22:26:43.754ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
117112024-12-20T22:26:43.754ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
117122024-12-20T22:26:43.879ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e0f06106-96ac-447e-be72-9c22380afc2c", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
117132024-12-20T22:26:43.879ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
117142024-12-20T22:26:43.879ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
117152024-12-20T22:26:43.879ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ecd9021-14c9-41ab-a34d-994e1a28d58f", "content-length": "682", "date": "Fri, 20 Dec 2024 22:26:43 GMT"} })
117162024-12-20T22:26:43.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117172024-12-20T22:26:43.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117182024-12-20T22:26:43.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117192024-12-20T22:26:43.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117202024-12-20T22:26:43.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117212024-12-20T22:26:43.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117222024-12-20T22:26:43.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117232024-12-20T22:26:43.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117242024-12-20T22:26:43.896ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 451.513925ms iteration = 26 status = {}
117252024-12-20T22:26:43.968ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47845
117262024-12-20T22:26:43.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47845 req_id = 56ce2e21-2ab6-472b-98d9-b0c29848e679 roles = RoleSet { roles: {} } uri = /metrics/producers
117272024-12-20T22:26:43.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47845 req_id = 56ce2e21-2ab6-472b-98d9-b0c29848e679 resource = Database result = Ok(()) uri = /metrics/producers
117282024-12-20T22:26:43.979ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 99b0250f-bcf3-46ae-aea9-2bb2360d90eb
117292024-12-20T22:26:43.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11546 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47845 req_id = 56ce2e21-2ab6-472b-98d9-b0c29848e679 response_code = 201 uri = /metrics/producers
117302024-12-20T22:26:44.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a00d086d-3fc4-40d6-ba86-129a02e013d9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117312024-12-20T22:26:44.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a00d086d-3fc4-40d6-ba86-129a02e013d9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117322024-12-20T22:26:44.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a00d086d-3fc4-40d6-ba86-129a02e013d9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117332024-12-20T22:26:45.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 33f6bd87-562e-4871-b4a0-7f752793311c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117342024-12-20T22:26:45.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 33f6bd87-562e-4871-b4a0-7f752793311c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117352024-12-20T22:26:45.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 33f6bd87-562e-4871-b4a0-7f752793311c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117362024-12-20T22:26:45.690ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1342 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = c8d321f4-72de-466e-94f7-f02ed3cb4230 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
117372024-12-20T22:26:46.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 75f59ea4-3d18-4b41-a0b2-d345824a492b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117382024-12-20T22:26:46.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 75f59ea4-3d18-4b41-a0b2-d345824a492b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117392024-12-20T22:26:46.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 75f59ea4-3d18-4b41-a0b2-d345824a492b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117402024-12-20T22:26:47.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2dd59512-e388-467b-8f5b-5f8cb7f77a9d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117412024-12-20T22:26:47.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2dd59512-e388-467b-8f5b-5f8cb7f77a9d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117422024-12-20T22:26:47.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2dd59512-e388-467b-8f5b-5f8cb7f77a9d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117432024-12-20T22:26:47.799ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53254
117442024-12-20T22:26:47.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53254 req_id = 761a15be-fb51-4d5b-9e10-c46516bfb2d7 roles = RoleSet { roles: {} } uri = /metrics/producers
117452024-12-20T22:26:47.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53254 req_id = 761a15be-fb51-4d5b-9e10-c46516bfb2d7 resource = Database result = Ok(()) uri = /metrics/producers
117462024-12-20T22:26:47.809ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 03760c77-b0c3-42eb-a705-bfee77be2fbe
117472024-12-20T22:26:47.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10623 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53254 req_id = 761a15be-fb51-4d5b-9e10-c46516bfb2d7 response_code = 201 uri = /metrics/producers
117482024-12-20T22:26:48.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f2a1d267-9045-4dc1-87dd-e180a8f64a1e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
117492024-12-20T22:26:48.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f2a1d267-9045-4dc1-87dd-e180a8f64a1e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
117502024-12-20T22:26:48.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = f2a1d267-9045-4dc1-87dd-e180a8f64a1e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
117512024-12-20T22:26:48.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 95ef5834-4372-4e80-9d73-fb0e3264ed20 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117522024-12-20T22:26:48.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 95ef5834-4372-4e80-9d73-fb0e3264ed20 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117532024-12-20T22:26:48.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 95ef5834-4372-4e80-9d73-fb0e3264ed20 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117542024-12-20T22:26:48.406ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:59269
117552024-12-20T22:26:48.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59269 req_id = 9e545888-fdf4-433a-8ee3-0d577f703d79 roles = RoleSet { roles: {} } uri = /metrics/producers
117562024-12-20T22:26:48.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59269 req_id = 9e545888-fdf4-433a-8ee3-0d577f703d79 resource = Database result = Ok(()) uri = /metrics/producers
117572024-12-20T22:26:48.442ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = a0a780c3-0806-4044-8e4b-e91bf0405221
117582024-12-20T22:26:48.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36099 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59269 req_id = 9e545888-fdf4-433a-8ee3-0d577f703d79 response_code = 201 uri = /metrics/producers
117592024-12-20T22:26:49.037ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:64170
117602024-12-20T22:26:49.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64170 req_id = d1776e40-c15e-40d3-a69a-71821adab340 roles = RoleSet { roles: {} } uri = /metrics/producers
117612024-12-20T22:26:49.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64170 req_id = d1776e40-c15e-40d3-a69a-71821adab340 resource = Database result = Ok(()) uri = /metrics/producers
117622024-12-20T22:26:49.073ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 7f6e5691-338a-4d1e-8ab4-9564fc795162
117632024-12-20T22:26:49.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35291 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64170 req_id = d1776e40-c15e-40d3-a69a-71821adab340 response_code = 201 uri = /metrics/producers
117642024-12-20T22:26:49.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2c25ab1-f45a-4b14-a80d-9533ce350f86 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117652024-12-20T22:26:49.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2c25ab1-f45a-4b14-a80d-9533ce350f86 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117662024-12-20T22:26:49.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f2c25ab1-f45a-4b14-a80d-9533ce350f86 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117672024-12-20T22:26:50.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 51afcd42-a4b1-462f-a409-981be30bb5cb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117682024-12-20T22:26:50.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 51afcd42-a4b1-462f-a409-981be30bb5cb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117692024-12-20T22:26:50.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 51afcd42-a4b1-462f-a409-981be30bb5cb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117702024-12-20T22:26:51.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a2cfcde8-dbc6-4c7d-b547-73dbca00db1f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117712024-12-20T22:26:51.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a2cfcde8-dbc6-4c7d-b547-73dbca00db1f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117722024-12-20T22:26:51.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a2cfcde8-dbc6-4c7d-b547-73dbca00db1f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117732024-12-20T22:26:52.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ce1b8944-fd5c-4376-8f1c-74f2c94189eb roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117742024-12-20T22:26:52.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ce1b8944-fd5c-4376-8f1c-74f2c94189eb resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117752024-12-20T22:26:52.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ce1b8944-fd5c-4376-8f1c-74f2c94189eb response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117762024-12-20T22:26:53.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2522f65-8115-4f87-aa93-0ce53d150fca roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117772024-12-20T22:26:53.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2522f65-8115-4f87-aa93-0ce53d150fca resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117782024-12-20T22:26:53.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2522f65-8115-4f87-aa93-0ce53d150fca response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
117792024-12-20T22:26:53.444ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
117802024-12-20T22:26:53.444ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
117812024-12-20T22:26:53.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117822024-12-20T22:26:53.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117832024-12-20T22:26:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117842024-12-20T22:26:53.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117852024-12-20T22:26:53.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117862024-12-20T22:26:53.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117872024-12-20T22:26:53.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117882024-12-20T22:26:53.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117892024-12-20T22:26:53.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117902024-12-20T22:26:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117912024-12-20T22:26:53.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117922024-12-20T22:26:53.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
117932024-12-20T22:26:53.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117942024-12-20T22:26:53.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117952024-12-20T22:26:53.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
117962024-12-20T22:26:53.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.369895ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
117972024-12-20T22:26:53.475ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117982024-12-20T22:26:53.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117992024-12-20T22:26:53.477ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.540437ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118002024-12-20T22:26:54.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d28aaa22-a2b8-415f-8b4b-b7cce3b3cff3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118012024-12-20T22:26:54.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d28aaa22-a2b8-415f-8b4b-b7cce3b3cff3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118022024-12-20T22:26:54.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d28aaa22-a2b8-415f-8b4b-b7cce3b3cff3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118032024-12-20T22:26:55.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dfde7f64-fa51-4ce0-80a7-eecffa1a1b41 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118042024-12-20T22:26:55.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dfde7f64-fa51-4ce0-80a7-eecffa1a1b41 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118052024-12-20T22:26:55.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dfde7f64-fa51-4ce0-80a7-eecffa1a1b41 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118062024-12-20T22:26:55.692ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 0434bcef-007e-4216-b6aa-f782d45e8781 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
118072024-12-20T22:26:56.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 029d1304-debb-495f-85da-efae2fd6a457 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118082024-12-20T22:26:56.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 029d1304-debb-495f-85da-efae2fd6a457 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118092024-12-20T22:26:56.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 029d1304-debb-495f-85da-efae2fd6a457 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118102024-12-20T22:26:57.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5af9801e-dd84-4af7-86f7-f3fc2b1be24b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118112024-12-20T22:26:57.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5af9801e-dd84-4af7-86f7-f3fc2b1be24b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118122024-12-20T22:26:57.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5af9801e-dd84-4af7-86f7-f3fc2b1be24b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118132024-12-20T22:26:58.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4d778e81-46e2-4482-a118-16a86982c0aa roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118142024-12-20T22:26:58.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4d778e81-46e2-4482-a118-16a86982c0aa resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118152024-12-20T22:26:58.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4d778e81-46e2-4482-a118-16a86982c0aa response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118162024-12-20T22:26:59.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c23e29fd-51e7-435b-b166-20dc8ddfe8fc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118172024-12-20T22:26:59.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c23e29fd-51e7-435b-b166-20dc8ddfe8fc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118182024-12-20T22:26:59.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c23e29fd-51e7-435b-b166-20dc8ddfe8fc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118192024-12-20T22:27:00.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 219f7e56-7965-44e6-8665-bf01e56afb64 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118202024-12-20T22:27:00.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 219f7e56-7965-44e6-8665-bf01e56afb64 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118212024-12-20T22:27:00.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 219f7e56-7965-44e6-8665-bf01e56afb64 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118222024-12-20T22:27:01.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d5a36b6-ae9a-495e-96d1-efc4e6e3fde9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118232024-12-20T22:27:01.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d5a36b6-ae9a-495e-96d1-efc4e6e3fde9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118242024-12-20T22:27:01.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d5a36b6-ae9a-495e-96d1-efc4e6e3fde9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118252024-12-20T22:27:02.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a6475388-13a6-4e5f-8698-0026d05d654c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118262024-12-20T22:27:02.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a6475388-13a6-4e5f-8698-0026d05d654c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118272024-12-20T22:27:02.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a6475388-13a6-4e5f-8698-0026d05d654c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118282024-12-20T22:27:03.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
118292024-12-20T22:27:03.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
118302024-12-20T22:27:03.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118312024-12-20T22:27:03.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118322024-12-20T22:27:03.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118332024-12-20T22:27:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118342024-12-20T22:27:03.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118352024-12-20T22:27:03.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118362024-12-20T22:27:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118372024-12-20T22:27:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118382024-12-20T22:27:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118392024-12-20T22:27:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118402024-12-20T22:27:03.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118412024-12-20T22:27:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118422024-12-20T22:27:03.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118432024-12-20T22:27:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
118442024-12-20T22:27:03.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118452024-12-20T22:27:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118462024-12-20T22:27:03.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
118472024-12-20T22:27:03.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.543807ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
118482024-12-20T22:27:03.477ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.826121ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118492024-12-20T22:27:03.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6e9340c5-aec5-4455-8bbb-5462b1e61cf2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118502024-12-20T22:27:03.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6e9340c5-aec5-4455-8bbb-5462b1e61cf2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118512024-12-20T22:27:03.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6e9340c5-aec5-4455-8bbb-5462b1e61cf2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118522024-12-20T22:27:04.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 62d1d14c-a5cd-49a9-9972-debaa664727d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118532024-12-20T22:27:04.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 62d1d14c-a5cd-49a9-9972-debaa664727d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118542024-12-20T22:27:04.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 62d1d14c-a5cd-49a9-9972-debaa664727d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118552024-12-20T22:27:05.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 435c0d4e-5027-41b0-895a-82f8cdac4560 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118562024-12-20T22:27:05.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 435c0d4e-5027-41b0-895a-82f8cdac4560 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118572024-12-20T22:27:05.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 435c0d4e-5027-41b0-895a-82f8cdac4560 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118582024-12-20T22:27:05.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1575 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 67897dc8-9be1-49d9-9e98-abab8ed9b8b3 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
118592024-12-20T22:27:06.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ec0b7a09-3ede-4a2e-8375-995af8f06046 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118602024-12-20T22:27:06.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ec0b7a09-3ede-4a2e-8375-995af8f06046 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118612024-12-20T22:27:06.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ec0b7a09-3ede-4a2e-8375-995af8f06046 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118622024-12-20T22:27:07.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 841e5b35-ba6a-46e0-966d-a181ff671a08 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118632024-12-20T22:27:07.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 841e5b35-ba6a-46e0-966d-a181ff671a08 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118642024-12-20T22:27:07.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 841e5b35-ba6a-46e0-966d-a181ff671a08 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118652024-12-20T22:27:08.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba058e6d-ef73-420c-8f26-c701e60fb508 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118662024-12-20T22:27:08.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba058e6d-ef73-420c-8f26-c701e60fb508 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118672024-12-20T22:27:08.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ba058e6d-ef73-420c-8f26-c701e60fb508 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118682024-12-20T22:27:09.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bebe3b26-ea80-49be-89a6-ae3ca5aeba3f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118692024-12-20T22:27:09.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bebe3b26-ea80-49be-89a6-ae3ca5aeba3f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118702024-12-20T22:27:09.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bebe3b26-ea80-49be-89a6-ae3ca5aeba3f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118712024-12-20T22:27:10.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 54efbd59-3fbc-4284-90a8-033c65c19ff0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118722024-12-20T22:27:10.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 54efbd59-3fbc-4284-90a8-033c65c19ff0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118732024-12-20T22:27:10.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 54efbd59-3fbc-4284-90a8-033c65c19ff0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118742024-12-20T22:27:10.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 1a31a3a0-8153-44a2-9070-f7e143b42782 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
118752024-12-20T22:27:10.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 1a31a3a0-8153-44a2-9070-f7e143b42782 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
118762024-12-20T22:27:10.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 1a31a3a0-8153-44a2-9070-f7e143b42782 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
118772024-12-20T22:27:10.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 56df7338-38ad-4de4-b5c8-2d27b247c672 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
118782024-12-20T22:27:10.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 56df7338-38ad-4de4-b5c8-2d27b247c672 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
118792024-12-20T22:27:10.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 56df7338-38ad-4de4-b5c8-2d27b247c672 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
118802024-12-20T22:27:11.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35d61fd2-d9cb-4fda-aeef-ea2f9fc98c8d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118812024-12-20T22:27:11.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35d61fd2-d9cb-4fda-aeef-ea2f9fc98c8d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118822024-12-20T22:27:11.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35d61fd2-d9cb-4fda-aeef-ea2f9fc98c8d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118832024-12-20T22:27:12.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e29d5497-33b1-4ee7-8013-b66f592e0257 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118842024-12-20T22:27:12.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e29d5497-33b1-4ee7-8013-b66f592e0257 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118852024-12-20T22:27:12.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e29d5497-33b1-4ee7-8013-b66f592e0257 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
118862024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
118872024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
118882024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118892024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
118902024-12-20T22:27:13.445ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
118912024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
118922024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118932024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118942024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
118952024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
118962024-12-20T22:27:13.445ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:17:13.445514706 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
118972024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118982024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
118992024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
119002024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
119012024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119022024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119032024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
119042024-12-20T22:27:13.445ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
119052024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.28\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
119062024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
119072024-12-20T22:27:13.445ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
119082024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
119092024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
119102024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
119112024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119122024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
119132024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
119142024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
119152024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
119162024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119172024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
119182024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
119192024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
119202024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
119212024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
119222024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119232024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
119242024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
119252024-12-20T22:27:13.445ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
119262024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119272024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
119282024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
119292024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
119302024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
119312024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
119322024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
119332024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
119342024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
119352024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
119362024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
119372024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
119382024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
119392024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
119402024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
119412024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119422024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119432024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
119442024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
119452024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119462024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
119472024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119482024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119492024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119502024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119512024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119522024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119532024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119542024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119552024-12-20T22:27:13.446ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1660, tv_nsec: 371112524 } })
119562024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
119572024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119582024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
119592024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
119602024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
119612024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119622024-12-20T22:27:13.446ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1660, tv_nsec: 371331297 } })
119632024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
119642024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119652024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
119662024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
119672024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
119682024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119692024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119702024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
119712024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119722024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
119732024-12-20T22:27:13.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119742024-12-20T22:27:13.447ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
119752024-12-20T22:27:13.447ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.479595ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
119762024-12-20T22:27:13.447ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
119772024-12-20T22:27:13.447ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.698377ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
119782024-12-20T22:27:13.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119792024-12-20T22:27:13.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119802024-12-20T22:27:13.449ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.916009ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
119812024-12-20T22:27:13.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119822024-12-20T22:27:13.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1660, tv_nsec: 375393147 } })
119832024-12-20T22:27:13.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119842024-12-20T22:27:13.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
119852024-12-20T22:27:13.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119862024-12-20T22:27:13.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119872024-12-20T22:27:13.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119882024-12-20T22:27:13.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119892024-12-20T22:27:13.453ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119902024-12-20T22:27:13.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119912024-12-20T22:27:13.454ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119922024-12-20T22:27:13.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119932024-12-20T22:27:13.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119942024-12-20T22:27:13.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119952024-12-20T22:27:13.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119962024-12-20T22:27:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
119972024-12-20T22:27:13.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119982024-12-20T22:27:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119992024-12-20T22:27:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
120002024-12-20T22:27:13.456ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:17:13.445514706 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
120012024-12-20T22:27:13.456ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
120022024-12-20T22:27:13.456ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.220812ms iteration = 14 status = {"expiration":"2024-12-20T22:17:13.445514706Z","pruned":[]}
120032024-12-20T22:27:13.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120042024-12-20T22:27:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
120052024-12-20T22:27:13.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120062024-12-20T22:27:13.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
120072024-12-20T22:27:13.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120082024-12-20T22:27:13.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120092024-12-20T22:27:13.459ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
120102024-12-20T22:27:13.459ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
120112024-12-20T22:27:13.459ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 13.673288ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
120122024-12-20T22:27:13.459ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120132024-12-20T22:27:13.459ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120142024-12-20T22:27:13.460ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1660, tv_nsec: 385315207 } })
120152024-12-20T22:27:13.461ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
120162024-12-20T22:27:13.461ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.538667ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
120172024-12-20T22:27:13.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
120182024-12-20T22:27:13.462ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
120192024-12-20T22:27:13.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
120202024-12-20T22:27:13.462ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
120212024-12-20T22:27:13.462ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120222024-12-20T22:27:13.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120232024-12-20T22:27:13.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120242024-12-20T22:27:13.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120252024-12-20T22:27:13.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120262024-12-20T22:27:13.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120272024-12-20T22:27:13.466ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120282024-12-20T22:27:13.466ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
120292024-12-20T22:27:13.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120302024-12-20T22:27:13.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.090282ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120312024-12-20T22:27:13.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120322024-12-20T22:27:13.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120332024-12-20T22:27:13.469ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
120342024-12-20T22:27:13.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120352024-12-20T22:27:13.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120362024-12-20T22:27:13.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120372024-12-20T22:27:13.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120382024-12-20T22:27:13.475ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120392024-12-20T22:27:13.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120402024-12-20T22:27:13.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120412024-12-20T22:27:13.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
120422024-12-20T22:27:13.476ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120432024-12-20T22:27:13.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120442024-12-20T22:27:13.479ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1660, tv_nsec: 404014466 } })
120452024-12-20T22:27:13.479ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
120462024-12-20T22:27:13.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120472024-12-20T22:27:13.488ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
120482024-12-20T22:27:13.488ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 43.208675ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
120492024-12-20T22:27:13.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120502024-12-20T22:27:13.493ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120512024-12-20T22:27:13.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120522024-12-20T22:27:13.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120532024-12-20T22:27:13.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120542024-12-20T22:27:13.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120552024-12-20T22:27:13.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
120562024-12-20T22:27:13.499ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120572024-12-20T22:27:13.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120582024-12-20T22:27:13.500ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
120592024-12-20T22:27:13.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120602024-12-20T22:27:13.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120612024-12-20T22:27:13.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
120622024-12-20T22:27:13.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120632024-12-20T22:27:13.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120642024-12-20T22:27:13.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.197856ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
120652024-12-20T22:27:13.523ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
120662024-12-20T22:27:13.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
120672024-12-20T22:27:13.524ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.47251ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
120682024-12-20T22:27:13.525ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.150067ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
120692024-12-20T22:27:13.528ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120702024-12-20T22:27:13.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120712024-12-20T22:27:13.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120722024-12-20T22:27:13.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120732024-12-20T22:27:13.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120742024-12-20T22:27:13.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
120752024-12-20T22:27:13.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120762024-12-20T22:27:13.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120772024-12-20T22:27:13.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120782024-12-20T22:27:13.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120792024-12-20T22:27:13.542ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
120802024-12-20T22:27:13.542ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
120812024-12-20T22:27:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 96.831694ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
120822024-12-20T22:27:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
120832024-12-20T22:27:13.543ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120842024-12-20T22:27:13.543ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
120852024-12-20T22:27:13.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120862024-12-20T22:27:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120872024-12-20T22:27:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.158728ms iteration = 27 status = 0
120882024-12-20T22:27:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
120892024-12-20T22:27:13.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120902024-12-20T22:27:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120912024-12-20T22:27:13.551ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
120922024-12-20T22:27:13.551ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
120932024-12-20T22:27:13.551ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
120942024-12-20T22:27:13.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120952024-12-20T22:27:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120962024-12-20T22:27:13.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120972024-12-20T22:27:13.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120982024-12-20T22:27:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120992024-12-20T22:27:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
121002024-12-20T22:27:13.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121012024-12-20T22:27:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121022024-12-20T22:27:13.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121032024-12-20T22:27:13.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121042024-12-20T22:27:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
121052024-12-20T22:27:13.560ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
121062024-12-20T22:27:13.560ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
121072024-12-20T22:27:13.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121082024-12-20T22:27:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121092024-12-20T22:27:13.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
121102024-12-20T22:27:13.561ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121112024-12-20T22:27:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121122024-12-20T22:27:13.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121132024-12-20T22:27:13.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
121142024-12-20T22:27:13.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 117.478352ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
121152024-12-20T22:27:13.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
121162024-12-20T22:27:13.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121172024-12-20T22:27:13.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121182024-12-20T22:27:13.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
121192024-12-20T22:27:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
121202024-12-20T22:27:13.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 122.340132ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
121212024-12-20T22:27:13.568ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
121222024-12-20T22:27:13.568ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
121232024-12-20T22:27:13.568ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
121242024-12-20T22:27:13.568ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 123.002968ms iteration = 15 status = {"generation":1}
121252024-12-20T22:27:13.579ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
121262024-12-20T22:27:13.580ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
121272024-12-20T22:27:13.580ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
121282024-12-20T22:27:13.580ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.393493ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
121292024-12-20T22:27:13.584ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
121302024-12-20T22:27:13.584ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
121312024-12-20T22:27:13.584ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
121322024-12-20T22:27:13.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121332024-12-20T22:27:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121342024-12-20T22:27:13.601ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
121352024-12-20T22:27:13.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.690047ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
121362024-12-20T22:27:13.618ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
121372024-12-20T22:27:13.618ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 172.532347ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
121382024-12-20T22:27:13.623ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
121392024-12-20T22:27:13.623ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
121402024-12-20T22:27:13.623ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5abbc77a-9301-40d8-874b-08fe7b0e8b80", "content-length": "26", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
121412024-12-20T22:27:13.623ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
121422024-12-20T22:27:13.626ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
121432024-12-20T22:27:13.630ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
121442024-12-20T22:27:13.630ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
121452024-12-20T22:27:13.630ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1a653d7-9dc7-43e9-8077-4d24e66e33f7", "content-length": "26", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
121462024-12-20T22:27:13.630ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
121472024-12-20T22:27:13.632ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
121482024-12-20T22:27:13.632ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
121492024-12-20T22:27:13.632ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8da91c8-75e7-4b92-b61a-cb5e3b5f049e", "content-length": "26", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
121502024-12-20T22:27:13.632ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
121512024-12-20T22:27:13.633ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
121522024-12-20T22:27:13.634ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
121532024-12-20T22:27:13.642ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 196.170144ms iteration = 31 status = {"physical_disks_added":0}
121542024-12-20T22:27:13.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121552024-12-20T22:27:13.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121562024-12-20T22:27:13.647ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
121572024-12-20T22:27:13.647ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 201.537748ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
121582024-12-20T22:27:13.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 86ee1d4c-400f-456a-8435-0a66d29af9cf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
121592024-12-20T22:27:13.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 86ee1d4c-400f-456a-8435-0a66d29af9cf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
121602024-12-20T22:27:13.791ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.218554ms iteration = 27 status = {}
121612024-12-20T22:27:13.804ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
121622024-12-20T22:27:13.831ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
121632024-12-20T22:27:13.831ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
121642024-12-20T22:27:13.831ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
121652024-12-20T22:27:13.831ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8350b08f-af8f-4f99-8ef0-d07d04650897", "content-length": "2", "date": "Fri, 20 Dec 2024 22:27:12 GMT"} })
121662024-12-20T22:27:13.831ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e06ebb7c-bb6e-4667-a820-7cab019c05b5", "content-length": "372", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
121672024-12-20T22:27:13.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121682024-12-20T22:27:13.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121692024-12-20T22:27:13.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121702024-12-20T22:27:13.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121712024-12-20T22:27:13.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 86ee1d4c-400f-456a-8435-0a66d29af9cf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
121722024-12-20T22:27:13.835ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
121732024-12-20T22:27:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
121742024-12-20T22:27:13.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
121752024-12-20T22:27:13.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121762024-12-20T22:27:13.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121772024-12-20T22:27:13.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121782024-12-20T22:27:13.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121792024-12-20T22:27:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121802024-12-20T22:27:13.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121812024-12-20T22:27:13.840ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 394.746163ms iteration = 27 status = null
121822024-12-20T22:27:13.841ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
121832024-12-20T22:27:13.841ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
121842024-12-20T22:27:13.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121852024-12-20T22:27:13.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121862024-12-20T22:27:13.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
121872024-12-20T22:27:13.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121882024-12-20T22:27:13.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121892024-12-20T22:27:13.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121902024-12-20T22:27:13.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121912024-12-20T22:27:13.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121922024-12-20T22:27:13.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121932024-12-20T22:27:13.850ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
121942024-12-20T22:27:13.850ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
121952024-12-20T22:27:13.850ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
121962024-12-20T22:27:13.850ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 404.619752ms iteration = 15 status = {"generation":2}
121972024-12-20T22:27:13.854ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
121982024-12-20T22:27:13.854ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ee81c5c7-e7ab-4230-a7e8-e25358ed7b5a", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
121992024-12-20T22:27:13.854ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122002024-12-20T22:27:13.857ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "542f32ae-491c-4669-8bf5-3a2fd4fb9ab4", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122012024-12-20T22:27:13.857ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122022024-12-20T22:27:13.857ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
122032024-12-20T22:27:13.857ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
122042024-12-20T22:27:13.858ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2d436194-65c6-4387-8e10-f4cbc69ae50b", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
122052024-12-20T22:27:13.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122062024-12-20T22:27:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122072024-12-20T22:27:13.859ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122082024-12-20T22:27:13.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 413.250129ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
122092024-12-20T22:27:13.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122102024-12-20T22:27:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122112024-12-20T22:27:13.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122122024-12-20T22:27:13.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122132024-12-20T22:27:13.882ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
122142024-12-20T22:27:13.882ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122152024-12-20T22:27:13.883ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62026cd8-8db6-40b9-97a2-53595533566d", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
122162024-12-20T22:27:13.886ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 440.530064ms iteration = 29 status = {}
122172024-12-20T22:27:13.922ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
122182024-12-20T22:27:13.923ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7392a7a0-1e4e-4d30-bdf2-d3a6a7cf8c80", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
122192024-12-20T22:27:13.923ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
122202024-12-20T22:27:13.924ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3e92539d-653b-4d35-9aef-1a0f2988e1d5", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
122212024-12-20T22:27:13.924ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
122222024-12-20T22:27:13.926ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ef5dc743-5e64-4b41-9835-2b954e61a954", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
122232024-12-20T22:27:13.926ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
122242024-12-20T22:27:13.929ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
122252024-12-20T22:27:13.929ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 483.732218ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
122262024-12-20T22:27:13.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122272024-12-20T22:27:13.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122282024-12-20T22:27:13.970ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
122292024-12-20T22:27:13.971ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "77f9cda8-a6ed-44b5-ba93-dae6ff644f0e", "content-length": "691", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
122302024-12-20T22:27:13.971ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
122312024-12-20T22:27:13.971ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
122322024-12-20T22:27:13.971ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
122332024-12-20T22:27:13.972ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
122342024-12-20T22:27:13.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122352024-12-20T22:27:13.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122362024-12-20T22:27:13.973ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 528.085554ms iteration = 28 status = {}
122372024-12-20T22:27:13.979ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
122382024-12-20T22:27:13.980ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "18015dbf-5138-4eb5-a611-11fdb5efeabb", "content-length": "134", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
122392024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
122402024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
122412024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
122422024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
122432024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
122442024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
122452024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
122462024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
122472024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
122482024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
122492024-12-20T22:27:13.980ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
122502024-12-20T22:27:13.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122512024-12-20T22:27:13.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122522024-12-20T22:27:13.982ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
122532024-12-20T22:27:13.983ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "41aa0a09-825f-4a72-9ed7-4554e96688f8", "content-length": "2", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
122542024-12-20T22:27:13.983ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
122552024-12-20T22:27:13.983ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "87eeb4d3-db20-40fa-864e-7424406432cb", "content-length": "52", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
122562024-12-20T22:27:13.983ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
122572024-12-20T22:27:13.983ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
122582024-12-20T22:27:14.084ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2b927886-b306-420f-bcc5-65db6e414823", "date": "Fri, 20 Dec 2024 22:27:13 GMT"} })
122592024-12-20T22:27:14.084ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
122602024-12-20T22:27:14.084ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
122612024-12-20T22:27:14.084ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa3b68e2-0f11-4c94-89e3-7960729e5324", "content-length": "682", "date": "Fri, 20 Dec 2024 22:27:14 GMT"} })
122622024-12-20T22:27:14.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122632024-12-20T22:27:14.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122642024-12-20T22:27:14.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122652024-12-20T22:27:14.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122662024-12-20T22:27:14.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122672024-12-20T22:27:14.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122682024-12-20T22:27:14.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122692024-12-20T22:27:14.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122702024-12-20T22:27:14.101ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 655.475477ms iteration = 27 status = {}
122712024-12-20T22:27:14.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3c30cd82-e023-4baf-a145-b1d728a170f9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122722024-12-20T22:27:14.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3c30cd82-e023-4baf-a145-b1d728a170f9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122732024-12-20T22:27:14.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3c30cd82-e023-4baf-a145-b1d728a170f9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122742024-12-20T22:27:15.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1555 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 9b0cbbbf-b076-40cd-9696-912439ef4b20 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
122752024-12-20T22:27:15.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d249e78-0986-4c02-82b4-93bff0dd907d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122762024-12-20T22:27:15.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d249e78-0986-4c02-82b4-93bff0dd907d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122772024-12-20T22:27:15.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6d249e78-0986-4c02-82b4-93bff0dd907d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122782024-12-20T22:27:16.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 888282c6-4824-4e33-9f9c-e8642e33fe68 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122792024-12-20T22:27:16.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 888282c6-4824-4e33-9f9c-e8642e33fe68 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122802024-12-20T22:27:16.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 888282c6-4824-4e33-9f9c-e8642e33fe68 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122812024-12-20T22:27:17.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 808c290b-e0a1-42fb-a290-816b630a1aba roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122822024-12-20T22:27:17.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 808c290b-e0a1-42fb-a290-816b630a1aba resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122832024-12-20T22:27:17.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 808c290b-e0a1-42fb-a290-816b630a1aba response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122842024-12-20T22:27:18.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = aa2c3cef-cbac-45c4-a417-9dcf2cad7f40 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
122852024-12-20T22:27:18.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = aa2c3cef-cbac-45c4-a417-9dcf2cad7f40 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
122862024-12-20T22:27:18.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = aa2c3cef-cbac-45c4-a417-9dcf2cad7f40 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
122872024-12-20T22:27:18.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c10a94c2-09c0-4eb0-a76a-8c8b3085f4a6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122882024-12-20T22:27:18.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c10a94c2-09c0-4eb0-a76a-8c8b3085f4a6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122892024-12-20T22:27:18.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c10a94c2-09c0-4eb0-a76a-8c8b3085f4a6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
122902024-12-20T22:27:19.491ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
122912024-12-20T22:27:19.491ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
122922024-12-20T22:27:19.522ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
122932024-12-20T22:27:19.522ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36665
122942024-12-20T22:27:19.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36665 req_id = d2f588e7-a131-4caa-a149-ebda5da09690 roles = RoleSet { roles: {} } uri = /metrics/producers
122952024-12-20T22:27:19.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36665 req_id = d2f588e7-a131-4caa-a149-ebda5da09690 resource = Database result = Ok(()) uri = /metrics/producers
122962024-12-20T22:27:19.562ZINFOnexus: assigned collector to new producer collector_id = 5d539163-6f84-48f1-85f9-21095c2abbac file = nexus/src/app/oximeter.rs:76 producer_id = 73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
122972024-12-20T22:27:19.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39619 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36665 req_id = d2f588e7-a131-4caa-a149-ebda5da09690 response_code = 201 uri = /metrics/producers
122982024-12-20T22:27:19.562ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d2f588e7-a131-4caa-a149-ebda5da09690", "content-length": "41", "date": "Fri, 20 Dec 2024 22:27:19 GMT"} })
122992024-12-20T22:27:19.564ZDEBGnexus (producer-registration-task): registered with nexus successfully
123002024-12-20T22:27:19.564ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
123012024-12-20T22:27:19.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b2b2f196-824c-4da8-8860-9b313d83f0ea roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123022024-12-20T22:27:19.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b2b2f196-824c-4da8-8860-9b313d83f0ea resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123032024-12-20T22:27:19.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b2b2f196-824c-4da8-8860-9b313d83f0ea response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123042024-12-20T22:27:20.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 368b172d-7fb5-4e04-9891-257625ecaa5a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123052024-12-20T22:27:20.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 368b172d-7fb5-4e04-9891-257625ecaa5a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123062024-12-20T22:27:20.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 368b172d-7fb5-4e04-9891-257625ecaa5a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123072024-12-20T22:27:22.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1fb4a5b7-5ae4-4e70-881e-d4968d4cbed9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123082024-12-20T22:27:22.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1fb4a5b7-5ae4-4e70-881e-d4968d4cbed9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123092024-12-20T22:27:22.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1fb4a5b7-5ae4-4e70-881e-d4968d4cbed9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123102024-12-20T22:27:23.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = adb7b54f-22bd-4db9-b062-629ccbc9c697 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123112024-12-20T22:27:23.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = adb7b54f-22bd-4db9-b062-629ccbc9c697 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123122024-12-20T22:27:23.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = adb7b54f-22bd-4db9-b062-629ccbc9c697 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123132024-12-20T22:27:23.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
123142024-12-20T22:27:23.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
123152024-12-20T22:27:23.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123162024-12-20T22:27:23.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123172024-12-20T22:27:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123182024-12-20T22:27:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123192024-12-20T22:27:23.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123202024-12-20T22:27:23.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123212024-12-20T22:27:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123222024-12-20T22:27:23.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.790179ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123232024-12-20T22:27:23.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123242024-12-20T22:27:23.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123252024-12-20T22:27:23.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123262024-12-20T22:27:23.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123272024-12-20T22:27:23.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123282024-12-20T22:27:23.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123292024-12-20T22:27:23.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
123302024-12-20T22:27:23.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123312024-12-20T22:27:23.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123322024-12-20T22:27:23.472ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
123332024-12-20T22:27:23.472ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.348925ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
123342024-12-20T22:27:24.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 97faf629-a415-4e4d-a2d9-f7ed11a0e1f9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123352024-12-20T22:27:24.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 97faf629-a415-4e4d-a2d9-f7ed11a0e1f9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123362024-12-20T22:27:24.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 97faf629-a415-4e4d-a2d9-f7ed11a0e1f9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123372024-12-20T22:27:25.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af217e58-637f-4d35-a329-82bc9d910f72 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123382024-12-20T22:27:25.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af217e58-637f-4d35-a329-82bc9d910f72 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123392024-12-20T22:27:25.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = af217e58-637f-4d35-a329-82bc9d910f72 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123402024-12-20T22:27:25.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1518 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 5e130261-a01e-4b08-b09a-d603e8e3a04d response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
123412024-12-20T22:27:26.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 78ab7e85-6045-42e3-8091-bb0343d51716 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123422024-12-20T22:27:26.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 78ab7e85-6045-42e3-8091-bb0343d51716 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123432024-12-20T22:27:26.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 78ab7e85-6045-42e3-8091-bb0343d51716 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123442024-12-20T22:27:27.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8ae5935-6d4a-44d0-9939-b8ba991c532f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123452024-12-20T22:27:27.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8ae5935-6d4a-44d0-9939-b8ba991c532f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123462024-12-20T22:27:27.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e8ae5935-6d4a-44d0-9939-b8ba991c532f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123472024-12-20T22:27:28.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f6824e6-6518-4caf-9b1f-7de99e363f79 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123482024-12-20T22:27:28.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f6824e6-6518-4caf-9b1f-7de99e363f79 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123492024-12-20T22:27:28.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5f6824e6-6518-4caf-9b1f-7de99e363f79 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123502024-12-20T22:27:29.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3d3d53a7-da00-492a-8514-48c6014b4f00 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123512024-12-20T22:27:29.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3d3d53a7-da00-492a-8514-48c6014b4f00 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123522024-12-20T22:27:29.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3d3d53a7-da00-492a-8514-48c6014b4f00 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123532024-12-20T22:27:30.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e96d9e59-e967-4690-9651-2136a2b440a0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123542024-12-20T22:27:30.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e96d9e59-e967-4690-9651-2136a2b440a0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123552024-12-20T22:27:30.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e96d9e59-e967-4690-9651-2136a2b440a0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123562024-12-20T22:27:31.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f0014ab4-bc1f-4af1-a2df-a95f250e00a4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123572024-12-20T22:27:31.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f0014ab4-bc1f-4af1-a2df-a95f250e00a4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123582024-12-20T22:27:31.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f0014ab4-bc1f-4af1-a2df-a95f250e00a4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123592024-12-20T22:27:32.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 55beb451-dcb7-4a59-a35d-808f4268513d roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123602024-12-20T22:27:32.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 55beb451-dcb7-4a59-a35d-808f4268513d resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123612024-12-20T22:27:32.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 55beb451-dcb7-4a59-a35d-808f4268513d response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123622024-12-20T22:27:33.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12d3d478-a3e3-4958-bd1e-461468622656 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123632024-12-20T22:27:33.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12d3d478-a3e3-4958-bd1e-461468622656 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123642024-12-20T22:27:33.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 12d3d478-a3e3-4958-bd1e-461468622656 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123652024-12-20T22:27:33.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
123662024-12-20T22:27:33.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
123672024-12-20T22:27:33.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123682024-12-20T22:27:33.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123692024-12-20T22:27:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123702024-12-20T22:27:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123712024-12-20T22:27:33.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123722024-12-20T22:27:33.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123732024-12-20T22:27:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123742024-12-20T22:27:33.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.288113ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123752024-12-20T22:27:33.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123762024-12-20T22:27:33.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123772024-12-20T22:27:33.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123782024-12-20T22:27:33.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123792024-12-20T22:27:33.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123802024-12-20T22:27:33.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123812024-12-20T22:27:33.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
123822024-12-20T22:27:33.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123832024-12-20T22:27:33.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123842024-12-20T22:27:33.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
123852024-12-20T22:27:33.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.94627ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
123862024-12-20T22:27:34.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5d80828f-32c2-4fdd-987a-4250debdfb87 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123872024-12-20T22:27:34.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5d80828f-32c2-4fdd-987a-4250debdfb87 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123882024-12-20T22:27:34.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5d80828f-32c2-4fdd-987a-4250debdfb87 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123892024-12-20T22:27:35.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fb598ad8-1c33-4d6a-bfec-653a2ee9fbd3 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123902024-12-20T22:27:35.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fb598ad8-1c33-4d6a-bfec-653a2ee9fbd3 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123912024-12-20T22:27:35.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fb598ad8-1c33-4d6a-bfec-653a2ee9fbd3 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123922024-12-20T22:27:35.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1670 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 033a66a9-0cf8-431a-8fe1-9c1ec6a6d343 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
123932024-12-20T22:27:36.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa5a2803-c4a6-49ba-afb5-1f49c32684ac roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123942024-12-20T22:27:36.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa5a2803-c4a6-49ba-afb5-1f49c32684ac resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123952024-12-20T22:27:36.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fa5a2803-c4a6-49ba-afb5-1f49c32684ac response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123962024-12-20T22:27:37.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e5c8cf0f-f5bd-436e-890e-11f652e976cc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123972024-12-20T22:27:37.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e5c8cf0f-f5bd-436e-890e-11f652e976cc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123982024-12-20T22:27:37.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e5c8cf0f-f5bd-436e-890e-11f652e976cc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
123992024-12-20T22:27:38.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 44bc47da-4fce-4c38-bd62-e19521381aac roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124002024-12-20T22:27:38.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 44bc47da-4fce-4c38-bd62-e19521381aac resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124012024-12-20T22:27:38.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 44bc47da-4fce-4c38-bd62-e19521381aac response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124022024-12-20T22:27:39.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = acdf7bb9-9382-465b-998b-221a5717e539 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124032024-12-20T22:27:39.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = acdf7bb9-9382-465b-998b-221a5717e539 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124042024-12-20T22:27:39.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = acdf7bb9-9382-465b-998b-221a5717e539 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124052024-12-20T22:27:40.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 998269d9-954e-4cb7-b31d-619921746698 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124062024-12-20T22:27:40.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 998269d9-954e-4cb7-b31d-619921746698 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124072024-12-20T22:27:40.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 998269d9-954e-4cb7-b31d-619921746698 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124082024-12-20T22:27:40.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 379170f6-fe71-4705-bab4-690a4394254f roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
124092024-12-20T22:27:40.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 379170f6-fe71-4705-bab4-690a4394254f resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
124102024-12-20T22:27:40.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 379170f6-fe71-4705-bab4-690a4394254f response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
124112024-12-20T22:27:40.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 8db7eb76-23a6-488e-8436-df6d605911c3 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
124122024-12-20T22:27:40.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 8db7eb76-23a6-488e-8436-df6d605911c3 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
124132024-12-20T22:27:40.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 8db7eb76-23a6-488e-8436-df6d605911c3 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
124142024-12-20T22:27:41.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a273156c-011c-4199-93ed-611e9519c93f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124152024-12-20T22:27:41.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a273156c-011c-4199-93ed-611e9519c93f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124162024-12-20T22:27:41.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a273156c-011c-4199-93ed-611e9519c93f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124172024-12-20T22:27:42.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = beb8c50f-24d4-4f93-ac09-20cedad34b05 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124182024-12-20T22:27:42.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = beb8c50f-24d4-4f93-ac09-20cedad34b05 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124192024-12-20T22:27:42.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = beb8c50f-24d4-4f93-ac09-20cedad34b05 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
124202024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
124212024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
124222024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
124232024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124242024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
124252024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
124262024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
124272024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
124282024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
124292024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124302024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
124312024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
124322024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
124332024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
124342024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
124352024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124362024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124372024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124382024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
124392024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
124402024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
124412024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
124422024-12-20T22:27:43.445ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
124432024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124442024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124452024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
124462024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
124472024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124482024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
124492024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
124502024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124512024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
124522024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
124532024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
124542024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
124552024-12-20T22:27:43.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
124562024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
124572024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
124582024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124592024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124602024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
124612024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124622024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
124632024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124642024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124652024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
124662024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124672024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124682024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124692024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
124702024-12-20T22:27:43.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
124712024-12-20T22:27:43.449ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.507425ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
124722024-12-20T22:27:43.449ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124732024-12-20T22:27:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124742024-12-20T22:27:43.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124752024-12-20T22:27:43.449ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
124762024-12-20T22:27:43.449ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
124772024-12-20T22:27:43.449ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124782024-12-20T22:27:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124792024-12-20T22:27:43.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
124802024-12-20T22:27:43.450ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124812024-12-20T22:27:43.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1690, tv_nsec: 375449888 } })
124822024-12-20T22:27:43.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
124832024-12-20T22:27:43.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
124842024-12-20T22:27:43.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
124852024-12-20T22:27:43.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124862024-12-20T22:27:43.452ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124872024-12-20T22:27:43.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124882024-12-20T22:27:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
124892024-12-20T22:27:43.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124902024-12-20T22:27:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124912024-12-20T22:27:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124922024-12-20T22:27:43.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124932024-12-20T22:27:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124942024-12-20T22:27:43.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
124952024-12-20T22:27:43.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124962024-12-20T22:27:43.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124972024-12-20T22:27:43.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
124982024-12-20T22:27:43.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
124992024-12-20T22:27:43.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
125002024-12-20T22:27:43.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125012024-12-20T22:27:43.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.859669ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
125022024-12-20T22:27:43.458ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1690, tv_nsec: 383319547 } })
125032024-12-20T22:27:43.459ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
125042024-12-20T22:27:43.459ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
125052024-12-20T22:27:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
125062024-12-20T22:27:43.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
125072024-12-20T22:27:43.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125082024-12-20T22:27:43.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125092024-12-20T22:27:43.463ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125102024-12-20T22:27:43.463ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
125112024-12-20T22:27:43.463ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125122024-12-20T22:27:43.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125132024-12-20T22:27:43.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125142024-12-20T22:27:43.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125152024-12-20T22:27:43.467ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125162024-12-20T22:27:43.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125172024-12-20T22:27:43.470ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1690, tv_nsec: 394452999 } })
125182024-12-20T22:27:43.470ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125192024-12-20T22:27:43.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125202024-12-20T22:27:43.470ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
125212024-12-20T22:27:43.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125222024-12-20T22:27:43.471ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
125232024-12-20T22:27:43.471ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 25.693439ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
125242024-12-20T22:27:43.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125252024-12-20T22:27:43.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
125262024-12-20T22:27:43.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125272024-12-20T22:27:43.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125282024-12-20T22:27:43.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
125292024-12-20T22:27:43.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125302024-12-20T22:27:43.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125312024-12-20T22:27:43.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4725b7c4-bf5d-48ac-9748-ecef6d7cd8e9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
125322024-12-20T22:27:43.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4725b7c4-bf5d-48ac-9748-ecef6d7cd8e9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
125332024-12-20T22:27:43.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4725b7c4-bf5d-48ac-9748-ecef6d7cd8e9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
125342024-12-20T22:27:43.497ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
125352024-12-20T22:27:43.497ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.980053ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
125362024-12-20T22:27:43.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.301117ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
125372024-12-20T22:27:43.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
125382024-12-20T22:27:43.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
125392024-12-20T22:27:43.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 61.243336ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
125402024-12-20T22:27:43.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125412024-12-20T22:27:43.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
125422024-12-20T22:27:43.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125432024-12-20T22:27:43.514ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125442024-12-20T22:27:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125452024-12-20T22:27:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125462024-12-20T22:27:43.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125472024-12-20T22:27:43.519ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125482024-12-20T22:27:43.519ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.123386ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
125492024-12-20T22:27:43.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125502024-12-20T22:27:43.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
125512024-12-20T22:27:43.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125522024-12-20T22:27:43.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125532024-12-20T22:27:43.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125542024-12-20T22:27:43.522ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125552024-12-20T22:27:43.522ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125562024-12-20T22:27:43.522ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
125572024-12-20T22:27:43.522ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 77.178587ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
125582024-12-20T22:27:43.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125592024-12-20T22:27:43.523ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.436ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125602024-12-20T22:27:43.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
125612024-12-20T22:27:43.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125622024-12-20T22:27:43.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125632024-12-20T22:27:43.528ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.47809ms iteration = 28 status = 0
125642024-12-20T22:27:43.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125652024-12-20T22:27:43.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125662024-12-20T22:27:43.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125672024-12-20T22:27:43.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125682024-12-20T22:27:43.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125692024-12-20T22:27:43.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125702024-12-20T22:27:43.539ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
125712024-12-20T22:27:43.539ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125722024-12-20T22:27:43.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125732024-12-20T22:27:43.540ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bd6f9fc-643b-4382-a679-9b24f10ecca3", "content-length": "26", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
125742024-12-20T22:27:43.540ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125752024-12-20T22:27:43.544ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125762024-12-20T22:27:43.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125772024-12-20T22:27:43.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125782024-12-20T22:27:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125792024-12-20T22:27:43.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.472982ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
125802024-12-20T22:27:43.594ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
125812024-12-20T22:27:43.594ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125822024-12-20T22:27:43.594ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "deddb09b-dbe1-461c-8eb4-817b5702a600", "content-length": "26", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
125832024-12-20T22:27:43.594ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125842024-12-20T22:27:43.597ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125852024-12-20T22:27:43.598ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
125862024-12-20T22:27:43.598ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125872024-12-20T22:27:43.599ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1bc5b63-1578-4754-a31f-c189d8639e24", "content-length": "26", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
125882024-12-20T22:27:43.599ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125892024-12-20T22:27:43.602ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
125902024-12-20T22:27:43.603ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.94693ms iteration = 32 status = {"physical_disks_added":0}
125912024-12-20T22:27:43.685ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
125922024-12-20T22:27:43.685ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8782de5b-f30b-4ad7-b514-8f4642df3e4e", "content-length": "691", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
125932024-12-20T22:27:43.685ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
125942024-12-20T22:27:43.685ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
125952024-12-20T22:27:43.685ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
125962024-12-20T22:27:43.688ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 242.573272ms iteration = 29 status = {}
125972024-12-20T22:27:43.688ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 242.982575ms iteration = 28 status = {}
125982024-12-20T22:27:43.703ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
125992024-12-20T22:27:43.703ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126002024-12-20T22:27:43.703ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a01360d-dea4-492a-bb80-6bc58d861517", "content-length": "372", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
126012024-12-20T22:27:43.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126022024-12-20T22:27:43.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126032024-12-20T22:27:43.708ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
126042024-12-20T22:27:43.708ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b25dba41-0293-4cbd-9289-a98290870576", "content-length": "2", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
126052024-12-20T22:27:43.709ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126062024-12-20T22:27:43.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126072024-12-20T22:27:43.711ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 265.819035ms iteration = 28 status = null
126082024-12-20T22:27:43.718ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
126092024-12-20T22:27:43.718ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
126102024-12-20T22:27:43.718ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e762425c-55dc-48a3-bb09-589d7d5fbaaa", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
126112024-12-20T22:27:43.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126122024-12-20T22:27:43.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126132024-12-20T22:27:43.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126142024-12-20T22:27:43.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126152024-12-20T22:27:43.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126162024-12-20T22:27:43.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126172024-12-20T22:27:43.727ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
126182024-12-20T22:27:43.727ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126192024-12-20T22:27:43.727ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1b375847-6aee-4754-8289-8f28856c7e37", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
126202024-12-20T22:27:43.729ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 283.661115ms iteration = 30 status = {}
126212024-12-20T22:27:43.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126222024-12-20T22:27:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126232024-12-20T22:27:43.793ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
126242024-12-20T22:27:43.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126252024-12-20T22:27:43.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126262024-12-20T22:27:43.804ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
126272024-12-20T22:27:43.804ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a42bdd35-b0a3-456b-b5b6-9b27ddee1e69", "content-length": "134", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
126282024-12-20T22:27:43.804ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
126292024-12-20T22:27:43.804ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
126302024-12-20T22:27:43.805ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
126312024-12-20T22:27:43.805ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
126322024-12-20T22:27:43.805ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126332024-12-20T22:27:43.805ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126342024-12-20T22:27:43.805ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126352024-12-20T22:27:43.805ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126362024-12-20T22:27:43.805ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126372024-12-20T22:27:43.805ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126382024-12-20T22:27:43.805ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
126392024-12-20T22:27:43.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126402024-12-20T22:27:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126412024-12-20T22:27:43.808ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
126422024-12-20T22:27:43.808ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "03548854-81e0-4d95-b390-318dfb28af45", "content-length": "2", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
126432024-12-20T22:27:43.808ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
126442024-12-20T22:27:43.808ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f813392a-bd58-41cb-aa27-3de10dde5073", "content-length": "52", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
126452024-12-20T22:27:43.808ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
126462024-12-20T22:27:43.808ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
126472024-12-20T22:27:43.956ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9d757944-55cc-4d33-8287-9e77c20e2108", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
126482024-12-20T22:27:43.956ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
126492024-12-20T22:27:43.956ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
126502024-12-20T22:27:43.957ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "143557d8-b370-48e6-8140-e9b90296fb23", "content-length": "682", "date": "Fri, 20 Dec 2024 22:27:43 GMT"} })
126512024-12-20T22:27:43.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126522024-12-20T22:27:43.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126532024-12-20T22:27:43.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126542024-12-20T22:27:43.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126552024-12-20T22:27:43.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126562024-12-20T22:27:43.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126572024-12-20T22:27:43.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126582024-12-20T22:27:43.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126592024-12-20T22:27:43.974ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 528.978693ms iteration = 28 status = {}
126602024-12-20T22:27:44.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 10fe3e4f-dfff-4cfd-a1bb-78a6e05a2b02 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126612024-12-20T22:27:44.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 10fe3e4f-dfff-4cfd-a1bb-78a6e05a2b02 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126622024-12-20T22:27:44.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 10fe3e4f-dfff-4cfd-a1bb-78a6e05a2b02 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126632024-12-20T22:27:45.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 128383bd-ea14-40b2-996c-60f2c9cc4e54 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126642024-12-20T22:27:45.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 128383bd-ea14-40b2-996c-60f2c9cc4e54 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126652024-12-20T22:27:45.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 128383bd-ea14-40b2-996c-60f2c9cc4e54 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126662024-12-20T22:27:45.692ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1548 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 47499cb4-d3c6-4140-92bc-62880cb6d168 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
126672024-12-20T22:27:46.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 67abf1d7-b9cb-4ca6-8903-211067399659 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126682024-12-20T22:27:46.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 67abf1d7-b9cb-4ca6-8903-211067399659 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126692024-12-20T22:27:46.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 67abf1d7-b9cb-4ca6-8903-211067399659 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126702024-12-20T22:27:47.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f4caf082-b654-4204-898e-23d7a3924743 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126712024-12-20T22:27:47.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f4caf082-b654-4204-898e-23d7a3924743 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126722024-12-20T22:27:47.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f4caf082-b654-4204-898e-23d7a3924743 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126732024-12-20T22:27:48.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = d8e43f5e-9c8b-4b4a-8013-cde5b06f24c6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
126742024-12-20T22:27:48.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = d8e43f5e-9c8b-4b4a-8013-cde5b06f24c6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
126752024-12-20T22:27:48.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = d8e43f5e-9c8b-4b4a-8013-cde5b06f24c6 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
126762024-12-20T22:27:48.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15436425-3ad6-4dac-916a-5c303989d99f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126772024-12-20T22:27:48.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15436425-3ad6-4dac-916a-5c303989d99f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126782024-12-20T22:27:48.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15436425-3ad6-4dac-916a-5c303989d99f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126792024-12-20T22:27:49.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 92bd04f5-21ce-4dcf-93b6-220ec0440e34 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126802024-12-20T22:27:49.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 92bd04f5-21ce-4dcf-93b6-220ec0440e34 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126812024-12-20T22:27:49.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 92bd04f5-21ce-4dcf-93b6-220ec0440e34 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126822024-12-20T22:27:50.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4154a121-fa68-4cba-b949-cb1b21cf2114 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126832024-12-20T22:27:50.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4154a121-fa68-4cba-b949-cb1b21cf2114 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126842024-12-20T22:27:50.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4154a121-fa68-4cba-b949-cb1b21cf2114 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126852024-12-20T22:27:51.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a86261cb-649c-4e69-b43f-ba67f8070d71 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126862024-12-20T22:27:51.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a86261cb-649c-4e69-b43f-ba67f8070d71 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126872024-12-20T22:27:51.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a86261cb-649c-4e69-b43f-ba67f8070d71 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126882024-12-20T22:27:52.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e3a7332f-190c-4eee-8d97-4679821181c2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126892024-12-20T22:27:52.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e3a7332f-190c-4eee-8d97-4679821181c2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126902024-12-20T22:27:52.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = e3a7332f-190c-4eee-8d97-4679821181c2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
126912024-12-20T22:27:53.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
126922024-12-20T22:27:53.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126932024-12-20T22:27:53.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
126942024-12-20T22:27:53.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126952024-12-20T22:27:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126962024-12-20T22:27:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126972024-12-20T22:27:53.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126982024-12-20T22:27:53.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126992024-12-20T22:27:53.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127002024-12-20T22:27:53.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.648977ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127012024-12-20T22:27:53.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127022024-12-20T22:27:53.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127032024-12-20T22:27:53.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127042024-12-20T22:27:53.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127052024-12-20T22:27:53.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127062024-12-20T22:27:53.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127072024-12-20T22:27:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
127082024-12-20T22:27:53.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127092024-12-20T22:27:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127102024-12-20T22:27:53.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
127112024-12-20T22:27:53.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.207404ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
127122024-12-20T22:27:53.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4a5f3593-d339-49a2-b1f7-00358d315482 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127132024-12-20T22:27:53.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4a5f3593-d339-49a2-b1f7-00358d315482 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127142024-12-20T22:27:53.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4a5f3593-d339-49a2-b1f7-00358d315482 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127152024-12-20T22:27:54.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2c76ffc0-6336-42ca-a8be-6d22fccc247e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127162024-12-20T22:27:54.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2c76ffc0-6336-42ca-a8be-6d22fccc247e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127172024-12-20T22:27:54.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2c76ffc0-6336-42ca-a8be-6d22fccc247e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127182024-12-20T22:27:55.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1401 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = cd43ed84-94dc-4064-828a-281dca20f24a response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
127192024-12-20T22:27:55.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 359365bd-b242-4190-bae0-f97a242046d9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127202024-12-20T22:27:55.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 359365bd-b242-4190-bae0-f97a242046d9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127212024-12-20T22:27:55.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 359365bd-b242-4190-bae0-f97a242046d9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127222024-12-20T22:27:56.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4b3e2b17-bca1-4ddd-9608-7edf09252980 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127232024-12-20T22:27:56.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4b3e2b17-bca1-4ddd-9608-7edf09252980 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127242024-12-20T22:27:56.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4b3e2b17-bca1-4ddd-9608-7edf09252980 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127252024-12-20T22:27:57.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 17515b03-1684-402c-8483-d256912ea8e6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127262024-12-20T22:27:57.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 17515b03-1684-402c-8483-d256912ea8e6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127272024-12-20T22:27:57.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 17515b03-1684-402c-8483-d256912ea8e6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127282024-12-20T22:27:58.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81bbcdf0-fc9b-4918-a5d5-e455202ac61e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127292024-12-20T22:27:58.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81bbcdf0-fc9b-4918-a5d5-e455202ac61e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127302024-12-20T22:27:58.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81bbcdf0-fc9b-4918-a5d5-e455202ac61e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127312024-12-20T22:27:59.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7ba4da6f-7674-4e48-9fb4-6ea37116d4f5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127322024-12-20T22:27:59.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7ba4da6f-7674-4e48-9fb4-6ea37116d4f5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127332024-12-20T22:27:59.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7ba4da6f-7674-4e48-9fb4-6ea37116d4f5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127342024-12-20T22:28:00.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c1560f7e-2bfd-4ae3-831a-b5d18a680e25 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127352024-12-20T22:28:00.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c1560f7e-2bfd-4ae3-831a-b5d18a680e25 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127362024-12-20T22:28:00.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c1560f7e-2bfd-4ae3-831a-b5d18a680e25 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127372024-12-20T22:28:01.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 851d49a2-aa01-44ea-b12a-80a2842acafc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127382024-12-20T22:28:01.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 851d49a2-aa01-44ea-b12a-80a2842acafc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127392024-12-20T22:28:01.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 851d49a2-aa01-44ea-b12a-80a2842acafc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127402024-12-20T22:28:02.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ef3dd688-74a7-4215-aefb-598c444d4331 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127412024-12-20T22:28:02.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ef3dd688-74a7-4215-aefb-598c444d4331 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127422024-12-20T22:28:02.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ef3dd688-74a7-4215-aefb-598c444d4331 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127432024-12-20T22:28:03.445ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
127442024-12-20T22:28:03.445ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
127452024-12-20T22:28:03.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127462024-12-20T22:28:03.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127472024-12-20T22:28:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127482024-12-20T22:28:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127492024-12-20T22:28:03.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127502024-12-20T22:28:03.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127512024-12-20T22:28:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127522024-12-20T22:28:03.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.648577ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127532024-12-20T22:28:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127542024-12-20T22:28:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127552024-12-20T22:28:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127562024-12-20T22:28:03.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127572024-12-20T22:28:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127582024-12-20T22:28:03.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127592024-12-20T22:28:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
127602024-12-20T22:28:03.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127612024-12-20T22:28:03.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127622024-12-20T22:28:03.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
127632024-12-20T22:28:03.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.330244ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
127642024-12-20T22:28:03.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15cea897-97c4-4365-8579-e6c03806b351 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127652024-12-20T22:28:03.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15cea897-97c4-4365-8579-e6c03806b351 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127662024-12-20T22:28:03.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 15cea897-97c4-4365-8579-e6c03806b351 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127672024-12-20T22:28:04.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 08973542-a731-4dad-a9b6-b1c9811277bf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127682024-12-20T22:28:04.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 08973542-a731-4dad-a9b6-b1c9811277bf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127692024-12-20T22:28:04.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 08973542-a731-4dad-a9b6-b1c9811277bf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127702024-12-20T22:28:05.692ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1607 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 2c728003-1afc-4533-ba2e-f15aad0880e8 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
127712024-12-20T22:28:05.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4a497978-217f-406e-8046-e5f28c06507c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127722024-12-20T22:28:05.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4a497978-217f-406e-8046-e5f28c06507c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127732024-12-20T22:28:05.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 4a497978-217f-406e-8046-e5f28c06507c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127742024-12-20T22:28:06.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 04acd2fe-f25f-421c-ac1e-f2c02740c33b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127752024-12-20T22:28:06.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 04acd2fe-f25f-421c-ac1e-f2c02740c33b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127762024-12-20T22:28:06.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 04acd2fe-f25f-421c-ac1e-f2c02740c33b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127772024-12-20T22:28:08.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f56893f4-f5d6-4fc9-b947-315577b89cc9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127782024-12-20T22:28:08.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f56893f4-f5d6-4fc9-b947-315577b89cc9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127792024-12-20T22:28:08.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = f56893f4-f5d6-4fc9-b947-315577b89cc9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127802024-12-20T22:28:09.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2c11366-e4ae-4328-8013-94ac5eaf1c7b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127812024-12-20T22:28:09.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2c11366-e4ae-4328-8013-94ac5eaf1c7b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127822024-12-20T22:28:09.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c2c11366-e4ae-4328-8013-94ac5eaf1c7b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127832024-12-20T22:28:10.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a48f9023-8794-4be6-9dbc-625c0c8e8e24 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127842024-12-20T22:28:10.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a48f9023-8794-4be6-9dbc-625c0c8e8e24 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127852024-12-20T22:28:10.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = a48f9023-8794-4be6-9dbc-625c0c8e8e24 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127862024-12-20T22:28:10.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 7339b410-95cb-4d5c-9471-a8da8a17710b roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
127872024-12-20T22:28:10.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 7339b410-95cb-4d5c-9471-a8da8a17710b resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
127882024-12-20T22:28:10.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 7339b410-95cb-4d5c-9471-a8da8a17710b response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
127892024-12-20T22:28:10.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b67912e2-0484-435f-999a-9e0b250af68d roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
127902024-12-20T22:28:10.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b67912e2-0484-435f-999a-9e0b250af68d resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
127912024-12-20T22:28:10.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = b67912e2-0484-435f-999a-9e0b250af68d response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
127922024-12-20T22:28:11.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 90933a67-7d00-4e36-8e38-3a4c094733ab roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127932024-12-20T22:28:11.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 90933a67-7d00-4e36-8e38-3a4c094733ab resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127942024-12-20T22:28:11.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 90933a67-7d00-4e36-8e38-3a4c094733ab response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127952024-12-20T22:28:12.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 78e77232-65be-430d-8c5b-2ca45e22b293 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127962024-12-20T22:28:12.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 78e77232-65be-430d-8c5b-2ca45e22b293 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127972024-12-20T22:28:12.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 78e77232-65be-430d-8c5b-2ca45e22b293 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127982024-12-20T22:28:13.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c5761d48-b14b-406e-89fe-55234f000a3b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
127992024-12-20T22:28:13.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c5761d48-b14b-406e-89fe-55234f000a3b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
128002024-12-20T22:28:13.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c5761d48-b14b-406e-89fe-55234f000a3b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
128012024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
128022024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
128032024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128042024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
128052024-12-20T22:28:13.446ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
128062024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128072024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
128082024-12-20T22:28:13.446ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3
128092024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
128102024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.77\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3"}
128112024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
128122024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
128132024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128142024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128152024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
128162024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
128172024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
128182024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
128192024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128202024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
128212024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128222024-12-20T22:28:13.446ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:18:13.446419570 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
128232024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
128242024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
128252024-12-20T22:28:13.446ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
128262024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
128272024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
128282024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128292024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
128302024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
128312024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128322024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
128332024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
128342024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
128352024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
128362024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128372024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
128382024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
128392024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
128402024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
128412024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128422024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
128432024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
128442024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
128452024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128462024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
128472024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
128482024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
128492024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
128502024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128512024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128522024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
128532024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
128542024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
128552024-12-20T22:28:13.446ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
128562024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
128572024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
128582024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
128592024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
128602024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
128612024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
128622024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
128632024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128642024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128652024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128662024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128672024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128682024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
128692024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
128702024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128712024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
128722024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128732024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
128742024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
128752024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128762024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
128772024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128782024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128792024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128802024-12-20T22:28:13.447ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("238017a4-2d19-43d3-aa35-92a1ed3e9c3a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("57b826de-37e7-4730-9cdb-924c3900cca7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1720, tv_nsec: 371414787 } })
128812024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
128822024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
128832024-12-20T22:28:13.447ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0ea0c538-ca42-43f4-b086-de09467ad6b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78967d4a-2173-4657-b3f9-6776548b138f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8e8c9696-f4b2-47e2-a964-72d9f5195c67.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1720, tv_nsec: 371448168 } })
128842024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
128852024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
128862024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
128872024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
128882024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128892024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
128902024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.201622ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
128912024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
128922024-12-20T22:28:13.447ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.426685ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
128932024-12-20T22:28:13.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128942024-12-20T22:28:13.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128952024-12-20T22:28:13.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128962024-12-20T22:28:13.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1720, tv_nsec: 375593749 } })
128972024-12-20T22:28:13.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
128982024-12-20T22:28:13.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128992024-12-20T22:28:13.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129002024-12-20T22:28:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129012024-12-20T22:28:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
129022024-12-20T22:28:13.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129032024-12-20T22:28:13.453ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.146212ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
129042024-12-20T22:28:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129052024-12-20T22:28:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
129062024-12-20T22:28:13.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129072024-12-20T22:28:13.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129082024-12-20T22:28:13.455ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:18:13.446419570 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
129092024-12-20T22:28:13.455ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.377004ms iteration = 15 status = {"expiration":"2024-12-20T22:18:13.446419570Z","pruned":[]}
129102024-12-20T22:28:13.456ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129112024-12-20T22:28:13.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129122024-12-20T22:28:13.456ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1720, tv_nsec: 380889973 } })
129132024-12-20T22:28:13.456ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129142024-12-20T22:28:13.456ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
129152024-12-20T22:28:13.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129162024-12-20T22:28:13.457ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
129172024-12-20T22:28:13.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129182024-12-20T22:28:13.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129192024-12-20T22:28:13.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129202024-12-20T22:28:13.459ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129212024-12-20T22:28:13.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129222024-12-20T22:28:13.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129232024-12-20T22:28:13.460ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129242024-12-20T22:28:13.462ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129252024-12-20T22:28:13.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
129262024-12-20T22:28:13.463ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129272024-12-20T22:28:13.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
129282024-12-20T22:28:13.464ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
129292024-12-20T22:28:13.464ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129302024-12-20T22:28:13.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129312024-12-20T22:28:13.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129322024-12-20T22:28:13.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129332024-12-20T22:28:13.465ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
129342024-12-20T22:28:13.465ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
129352024-12-20T22:28:13.465ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.467726ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
129362024-12-20T22:28:13.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129372024-12-20T22:28:13.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 20.680068ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
129382024-12-20T22:28:13.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129392024-12-20T22:28:13.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129402024-12-20T22:28:13.468ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.970931ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
129412024-12-20T22:28:13.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129422024-12-20T22:28:13.470ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129432024-12-20T22:28:13.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129442024-12-20T22:28:13.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
129452024-12-20T22:28:13.471ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1720, tv_nsec: 396055075 } })
129462024-12-20T22:28:13.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129472024-12-20T22:28:13.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129482024-12-20T22:28:13.472ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
129492024-12-20T22:28:13.472ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129502024-12-20T22:28:13.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129512024-12-20T22:28:13.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129522024-12-20T22:28:13.477ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129532024-12-20T22:28:13.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129542024-12-20T22:28:13.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129552024-12-20T22:28:13.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129562024-12-20T22:28:13.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
129572024-12-20T22:28:13.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129582024-12-20T22:28:13.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
129592024-12-20T22:28:13.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129602024-12-20T22:28:13.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129612024-12-20T22:28:13.517ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129622024-12-20T22:28:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129632024-12-20T22:28:13.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129642024-12-20T22:28:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129652024-12-20T22:28:13.522ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129662024-12-20T22:28:13.523ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
129672024-12-20T22:28:13.523ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.687271ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
129682024-12-20T22:28:13.525ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
129692024-12-20T22:28:13.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
129702024-12-20T22:28:13.525ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
129712024-12-20T22:28:13.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
129722024-12-20T22:28:13.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
129732024-12-20T22:28:13.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129742024-12-20T22:28:13.528ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.201778ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129752024-12-20T22:28:13.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129762024-12-20T22:28:13.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.47956ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
129772024-12-20T22:28:13.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129782024-12-20T22:28:13.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129792024-12-20T22:28:13.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129802024-12-20T22:28:13.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129812024-12-20T22:28:13.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
129822024-12-20T22:28:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
129832024-12-20T22:28:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.692593ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
129842024-12-20T22:28:13.543ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129852024-12-20T22:28:13.543ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
129862024-12-20T22:28:13.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129872024-12-20T22:28:13.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129882024-12-20T22:28:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129892024-12-20T22:28:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129902024-12-20T22:28:13.543ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129912024-12-20T22:28:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129922024-12-20T22:28:13.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.921396ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129932024-12-20T22:28:13.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129942024-12-20T22:28:13.548ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
129952024-12-20T22:28:13.548ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
129962024-12-20T22:28:13.548ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
129972024-12-20T22:28:13.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129982024-12-20T22:28:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129992024-12-20T22:28:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130002024-12-20T22:28:13.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.810895ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
130012024-12-20T22:28:13.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130022024-12-20T22:28:13.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130032024-12-20T22:28:13.551ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130042024-12-20T22:28:13.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130052024-12-20T22:28:13.553ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
130062024-12-20T22:28:13.553ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.750485ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
130072024-12-20T22:28:13.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130082024-12-20T22:28:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
130092024-12-20T22:28:13.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130102024-12-20T22:28:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
130112024-12-20T22:28:13.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130122024-12-20T22:28:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130132024-12-20T22:28:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130142024-12-20T22:28:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130152024-12-20T22:28:13.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130162024-12-20T22:28:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130172024-12-20T22:28:13.565ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.033288ms iteration = 29 status = 0
130182024-12-20T22:28:13.565ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 118.940637ms iteration = 33 status = {"physical_disks_added":0}
130192024-12-20T22:28:13.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
130202024-12-20T22:28:13.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
130212024-12-20T22:28:13.587ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
130222024-12-20T22:28:13.588ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
130232024-12-20T22:28:13.588ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 141.538204ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
130242024-12-20T22:28:13.592ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130252024-12-20T22:28:13.593ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
130262024-12-20T22:28:13.593ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.469404ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
130272024-12-20T22:28:13.593ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
130282024-12-20T22:28:13.597ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
130292024-12-20T22:28:13.597ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
130302024-12-20T22:28:13.597ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
130312024-12-20T22:28:13.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130322024-12-20T22:28:13.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130332024-12-20T22:28:13.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130342024-12-20T22:28:13.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130352024-12-20T22:28:13.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130362024-12-20T22:28:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130372024-12-20T22:28:13.603ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
130382024-12-20T22:28:13.603ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130392024-12-20T22:28:13.603ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "48d7d48d-2dc1-4908-ab4e-18cb9f28c39f", "content-length": "26", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
130402024-12-20T22:28:13.603ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130412024-12-20T22:28:13.606ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
130422024-12-20T22:28:13.606ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
130432024-12-20T22:28:13.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130442024-12-20T22:28:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130452024-12-20T22:28:13.606ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130462024-12-20T22:28:13.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130472024-12-20T22:28:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130482024-12-20T22:28:13.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130492024-12-20T22:28:13.609ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
130502024-12-20T22:28:13.609ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 0 version = 2
130512024-12-20T22:28:13.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130522024-12-20T22:28:13.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130532024-12-20T22:28:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130542024-12-20T22:28:13.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130552024-12-20T22:28:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130562024-12-20T22:28:13.620ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
130572024-12-20T22:28:13.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
130582024-12-20T22:28:13.624ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130592024-12-20T22:28:13.624ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3bc12b0-9f7a-498f-98ed-fedb2ef0fc42", "content-length": "26", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
130602024-12-20T22:28:13.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130612024-12-20T22:28:13.627ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
130622024-12-20T22:28:13.644ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
130632024-12-20T22:28:13.644ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130642024-12-20T22:28:13.645ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "091b7bf3-54db-4282-86bf-bf45fed5dfb6", "content-length": "26", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
130652024-12-20T22:28:13.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130662024-12-20T22:28:13.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130672024-12-20T22:28:13.650ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130682024-12-20T22:28:13.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130692024-12-20T22:28:13.651ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
130702024-12-20T22:28:13.651ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 204.575419ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
130712024-12-20T22:28:13.801ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
130722024-12-20T22:28:13.801ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
130732024-12-20T22:28:13.801ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6c5e367-2bfd-4834-b15a-90aea34184ed", "content-length": "372", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
130742024-12-20T22:28:13.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130752024-12-20T22:28:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130762024-12-20T22:28:13.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130772024-12-20T22:28:13.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130782024-12-20T22:28:13.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130792024-12-20T22:28:13.805ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = a4315bdf-d20e-4b6c-802b-b695d5dcad1f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
130802024-12-20T22:28:13.805ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
130812024-12-20T22:28:13.806ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:14:47.751161 UTC dns_group = internal generation = 1
130822024-12-20T22:28:13.806ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 359.361047ms iteration = 16 status = {"generation":1}
130832024-12-20T22:28:13.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
130842024-12-20T22:28:13.807ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130852024-12-20T22:28:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130862024-12-20T22:28:13.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130872024-12-20T22:28:13.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130882024-12-20T22:28:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130892024-12-20T22:28:13.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130902024-12-20T22:28:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130912024-12-20T22:28:13.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130922024-12-20T22:28:13.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130932024-12-20T22:28:13.811ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 712337ee-b780-437a-a249-ed6ed033fce7 dns_zone_name = oxide.test found_so_far = 1 version = 2
130942024-12-20T22:28:13.811ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
130952024-12-20T22:28:13.811ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:14:48.587932 UTC dns_group = external generation = 2
130962024-12-20T22:28:13.811ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 364.387937ms iteration = 16 status = {"generation":2}
130972024-12-20T22:28:13.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130982024-12-20T22:28:13.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130992024-12-20T22:28:13.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131002024-12-20T22:28:13.819ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
131012024-12-20T22:28:13.824ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
131022024-12-20T22:28:13.824ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fd167d8-a80b-44fd-880c-c81fdede2375", "content-length": "2", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
131032024-12-20T22:28:13.827ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
131042024-12-20T22:28:13.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
131052024-12-20T22:28:13.829ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 383.53294ms iteration = 29 status = null
131062024-12-20T22:28:13.857ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:14:09.840743Z, time_modified: 2024-12-20T22:14:09.840743Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79569914-721c-4af5-b3de-b3d4df7ef204, db_silo: Silo { identity: SiloIdentity { id: 79569914-721c-4af5-b3de-b3d4df7ef204, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:14:48.546732Z, time_modified: 2024-12-20T22:14:48.546732Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad" }] }) }
131072024-12-20T22:28:13.857ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 410.854135ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]}},"default_endpoint":{"silo_id":"79569914-721c-4af5-b3de-b3d4df7ef204","tls_certs":["6fa21cfce48ebefa7947cd366a7e644950ecba360c15bb06cd8bdd4c951f80ad"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
131082024-12-20T22:28:13.869ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
131092024-12-20T22:28:13.869ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
131102024-12-20T22:28:13.869ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "db57601f-ef89-40c5-8b25-89ab0ed991af", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
131112024-12-20T22:28:13.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131122024-12-20T22:28:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131132024-12-20T22:28:13.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131142024-12-20T22:28:13.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131152024-12-20T22:28:13.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131162024-12-20T22:28:13.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131172024-12-20T22:28:13.879ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
131182024-12-20T22:28:13.879ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131192024-12-20T22:28:13.879ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5390e180-d655-4988-8278-f832fc0e1273", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
131202024-12-20T22:28:13.881ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 434.753126ms iteration = 31 status = {}
131212024-12-20T22:28:13.929ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
131222024-12-20T22:28:13.930ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "21633bf2-667d-4423-afb5-cd7098c0f418", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131232024-12-20T22:28:13.930ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131242024-12-20T22:28:13.932ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6d3d75f3-8cc7-45cf-b2e5-0b82c0e81f30", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131252024-12-20T22:28:13.932ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131262024-12-20T22:28:13.933ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131272024-12-20T22:28:13.933ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 487.207434ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
131282024-12-20T22:28:13.969ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
131292024-12-20T22:28:13.969ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5dc2a7e0-1946-433a-91cf-5d752a4a4caf", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
131302024-12-20T22:28:13.970ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
131312024-12-20T22:28:13.972ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "36db522d-8ada-4d18-b6ee-bcce9c1f15fe", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
131322024-12-20T22:28:13.972ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
131332024-12-20T22:28:13.973ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
131342024-12-20T22:28:13.973ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a64c94bd-d0f6-404c-beb6-239ce410d301", "content-length": "691", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
131352024-12-20T22:28:13.973ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
131362024-12-20T22:28:13.973ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
131372024-12-20T22:28:13.974ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
131382024-12-20T22:28:13.974ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0b2f261c-5ec0-4550-b886-99feb01e6064", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
131392024-12-20T22:28:13.974ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
131402024-12-20T22:28:13.975ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 529.709201ms iteration = 30 status = {}
131412024-12-20T22:28:13.977ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
131422024-12-20T22:28:13.977ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 531.088495ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
131432024-12-20T22:28:13.993ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 546.991775ms iteration = 29 status = {}
131442024-12-20T22:28:14.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131452024-12-20T22:28:14.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131462024-12-20T22:28:14.054ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
131472024-12-20T22:28:14.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131482024-12-20T22:28:14.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131492024-12-20T22:28:14.064ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
131502024-12-20T22:28:14.065ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe8d4596-bd3d-4c8b-859a-75e0b575460c", "content-length": "134", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
131512024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
131522024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
131532024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
131542024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
131552024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131562024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131572024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131582024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131592024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131602024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131612024-12-20T22:28:14.065ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
131622024-12-20T22:28:14.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131632024-12-20T22:28:14.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131642024-12-20T22:28:14.068ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
131652024-12-20T22:28:14.068ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc7e7d27-0220-4465-8a22-61deb9e65204", "content-length": "2", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
131662024-12-20T22:28:14.068ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
131672024-12-20T22:28:14.068ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "246c62e8-335d-4fc3-8325-3326334353e5", "content-length": "52", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
131682024-12-20T22:28:14.068ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
131692024-12-20T22:28:14.068ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
131702024-12-20T22:28:14.174ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "62dac4e7-62ee-435a-b6cf-004bc8f7a6e1", "date": "Fri, 20 Dec 2024 22:28:13 GMT"} })
131712024-12-20T22:28:14.174ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
131722024-12-20T22:28:14.174ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
131732024-12-20T22:28:14.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 37be9183-f2fe-4ed7-90c7-d68b9b9147fc roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131742024-12-20T22:28:14.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 37be9183-f2fe-4ed7-90c7-d68b9b9147fc resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131752024-12-20T22:28:14.175ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c37d204a-b3cc-4e47-9b9d-cfd5803ebb14", "content-length": "682", "date": "Fri, 20 Dec 2024 22:28:14 GMT"} })
131762024-12-20T22:28:14.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131772024-12-20T22:28:14.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131782024-12-20T22:28:14.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 37be9183-f2fe-4ed7-90c7-d68b9b9147fc response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131792024-12-20T22:28:14.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131802024-12-20T22:28:14.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131812024-12-20T22:28:14.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131822024-12-20T22:28:14.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131832024-12-20T22:28:14.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131842024-12-20T22:28:14.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131852024-12-20T22:28:14.193ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 746.864976ms iteration = 29 status = {}
131862024-12-20T22:28:15.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d6a0506-be46-4aff-82f9-fbd2c91c7b74 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131872024-12-20T22:28:15.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d6a0506-be46-4aff-82f9-fbd2c91c7b74 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131882024-12-20T22:28:15.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0d6a0506-be46-4aff-82f9-fbd2c91c7b74 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131892024-12-20T22:28:15.691ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1440 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 31b38a6e-bac0-44cc-8d8d-b00539066315 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
131902024-12-20T22:28:16.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d6be3c0b-45dd-47c5-b43e-a39ae5055c38 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131912024-12-20T22:28:16.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d6be3c0b-45dd-47c5-b43e-a39ae5055c38 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131922024-12-20T22:28:16.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = d6be3c0b-45dd-47c5-b43e-a39ae5055c38 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131932024-12-20T22:28:17.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b775d35d-7990-43d2-8e34-6438096a8e34 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131942024-12-20T22:28:17.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b775d35d-7990-43d2-8e34-6438096a8e34 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131952024-12-20T22:28:17.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b775d35d-7990-43d2-8e34-6438096a8e34 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
131962024-12-20T22:28:18.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 37319992-9670-47d7-8b71-1a29789b76bf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
131972024-12-20T22:28:18.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 37319992-9670-47d7-8b71-1a29789b76bf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
131982024-12-20T22:28:18.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 37319992-9670-47d7-8b71-1a29789b76bf response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
131992024-12-20T22:28:18.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b09ed9ae-b9b3-4b40-8349-d2869a2042bf roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132002024-12-20T22:28:18.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b09ed9ae-b9b3-4b40-8349-d2869a2042bf resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132012024-12-20T22:28:18.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b09ed9ae-b9b3-4b40-8349-d2869a2042bf response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132022024-12-20T22:28:19.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2fa608f6-2510-46bb-89f3-6ad77ed19ee9 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132032024-12-20T22:28:19.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2fa608f6-2510-46bb-89f3-6ad77ed19ee9 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132042024-12-20T22:28:19.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 2fa608f6-2510-46bb-89f3-6ad77ed19ee9 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132052024-12-20T22:28:20.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7327271f-dc2d-483a-a7cc-e39f56b1387e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132062024-12-20T22:28:20.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7327271f-dc2d-483a-a7cc-e39f56b1387e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132072024-12-20T22:28:20.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7327271f-dc2d-483a-a7cc-e39f56b1387e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132082024-12-20T22:28:21.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 46422e7e-8f1a-412f-bdfc-aeca9c135de7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132092024-12-20T22:28:21.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 46422e7e-8f1a-412f-bdfc-aeca9c135de7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132102024-12-20T22:28:21.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 46422e7e-8f1a-412f-bdfc-aeca9c135de7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132112024-12-20T22:28:22.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf756fad-e122-42fa-aa1d-940e2144d47a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132122024-12-20T22:28:22.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf756fad-e122-42fa-aa1d-940e2144d47a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132132024-12-20T22:28:22.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = bf756fad-e122-42fa-aa1d-940e2144d47a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132142024-12-20T22:28:23.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c4c72652-98a3-4437-83f6-e74926a92463 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132152024-12-20T22:28:23.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c4c72652-98a3-4437-83f6-e74926a92463 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132162024-12-20T22:28:23.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c4c72652-98a3-4437-83f6-e74926a92463 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132172024-12-20T22:28:23.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
132182024-12-20T22:28:23.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
132192024-12-20T22:28:23.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132202024-12-20T22:28:23.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132212024-12-20T22:28:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132222024-12-20T22:28:23.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132232024-12-20T22:28:23.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132242024-12-20T22:28:23.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132252024-12-20T22:28:23.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132262024-12-20T22:28:23.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.871669ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132272024-12-20T22:28:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132282024-12-20T22:28:23.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132292024-12-20T22:28:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132302024-12-20T22:28:23.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132312024-12-20T22:28:23.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132322024-12-20T22:28:23.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132332024-12-20T22:28:23.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
132342024-12-20T22:28:23.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132352024-12-20T22:28:23.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132362024-12-20T22:28:23.466ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
132372024-12-20T22:28:23.466ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.116112ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
132382024-12-20T22:28:24.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 09b9d515-160e-4bc8-9533-270cf227c679 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132392024-12-20T22:28:24.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 09b9d515-160e-4bc8-9533-270cf227c679 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132402024-12-20T22:28:24.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 09b9d515-160e-4bc8-9533-270cf227c679 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132412024-12-20T22:28:25.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 13d9d529-ae27-4a67-9b2e-6f1f71031314 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132422024-12-20T22:28:25.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 13d9d529-ae27-4a67-9b2e-6f1f71031314 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132432024-12-20T22:28:25.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 13d9d529-ae27-4a67-9b2e-6f1f71031314 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132442024-12-20T22:28:25.692ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1527 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 98bffed1-9a1f-48ef-b933-52a254f03d9d response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
132452024-12-20T22:28:26.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 70a5459e-3b03-442b-9522-0bd1a6e3d341 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132462024-12-20T22:28:26.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 70a5459e-3b03-442b-9522-0bd1a6e3d341 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132472024-12-20T22:28:26.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 70a5459e-3b03-442b-9522-0bd1a6e3d341 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132482024-12-20T22:28:27.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 48dc802e-4d2d-45a8-9942-53ee1e10a9f4 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132492024-12-20T22:28:27.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 48dc802e-4d2d-45a8-9942-53ee1e10a9f4 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132502024-12-20T22:28:27.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 48dc802e-4d2d-45a8-9942-53ee1e10a9f4 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132512024-12-20T22:28:28.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 34a26f51-95fb-4961-851c-33f7320eae90 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132522024-12-20T22:28:28.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 34a26f51-95fb-4961-851c-33f7320eae90 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132532024-12-20T22:28:28.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 34a26f51-95fb-4961-851c-33f7320eae90 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132542024-12-20T22:28:29.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8594a41-951e-419d-a354-9059d8302c2e roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132552024-12-20T22:28:29.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8594a41-951e-419d-a354-9059d8302c2e resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132562024-12-20T22:28:29.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b8594a41-951e-419d-a354-9059d8302c2e response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132572024-12-20T22:28:30.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3b456d1f-3db5-46b5-a63d-d51b4a4d0a71 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132582024-12-20T22:28:30.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3b456d1f-3db5-46b5-a63d-d51b4a4d0a71 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132592024-12-20T22:28:30.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3b456d1f-3db5-46b5-a63d-d51b4a4d0a71 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132602024-12-20T22:28:31.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 446ed08b-3c4d-451e-9d05-7fa8887bd146 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132612024-12-20T22:28:31.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 446ed08b-3c4d-451e-9d05-7fa8887bd146 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132622024-12-20T22:28:31.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 446ed08b-3c4d-451e-9d05-7fa8887bd146 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132632024-12-20T22:28:32.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 995a1a80-56a6-4322-8b09-55c19fe01176 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132642024-12-20T22:28:32.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 995a1a80-56a6-4322-8b09-55c19fe01176 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132652024-12-20T22:28:32.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2692 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 995a1a80-56a6-4322-8b09-55c19fe01176 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132662024-12-20T22:28:33.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
132672024-12-20T22:28:33.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132682024-12-20T22:28:33.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
132692024-12-20T22:28:33.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132702024-12-20T22:28:33.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132712024-12-20T22:28:33.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132722024-12-20T22:28:33.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132732024-12-20T22:28:33.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132742024-12-20T22:28:33.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132752024-12-20T22:28:33.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132762024-12-20T22:28:33.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132772024-12-20T22:28:33.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132782024-12-20T22:28:33.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132792024-12-20T22:28:33.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
132802024-12-20T22:28:33.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132812024-12-20T22:28:33.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132822024-12-20T22:28:33.470ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
132832024-12-20T22:28:33.470ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.716928ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
132842024-12-20T22:28:33.475ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132852024-12-20T22:28:33.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132862024-12-20T22:28:33.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.702471ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132872024-12-20T22:28:33.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c38d4608-6905-4b19-8993-81a975fdeee5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132882024-12-20T22:28:33.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c38d4608-6905-4b19-8993-81a975fdeee5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132892024-12-20T22:28:33.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = c38d4608-6905-4b19-8993-81a975fdeee5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132902024-12-20T22:28:34.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 96eddc05-b9e2-43c6-967d-187e8f0ca298 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132912024-12-20T22:28:34.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 96eddc05-b9e2-43c6-967d-187e8f0ca298 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132922024-12-20T22:28:34.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 96eddc05-b9e2-43c6-967d-187e8f0ca298 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132932024-12-20T22:28:35.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 18e3abbe-f463-4a87-a692-bb25c7011c0f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132942024-12-20T22:28:35.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 18e3abbe-f463-4a87-a692-bb25c7011c0f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132952024-12-20T22:28:35.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 18e3abbe-f463-4a87-a692-bb25c7011c0f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132962024-12-20T22:28:35.692ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1459 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 91dc8639-967c-4416-82aa-ee5dfdb9bc3f response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
132972024-12-20T22:28:36.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7baf1bdb-9697-49e6-8a5e-ee92eb907ff0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132982024-12-20T22:28:36.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7baf1bdb-9697-49e6-8a5e-ee92eb907ff0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
132992024-12-20T22:28:36.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 7baf1bdb-9697-49e6-8a5e-ee92eb907ff0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133002024-12-20T22:28:37.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fe371541-aff7-462f-ac3a-d197ab49048f roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133012024-12-20T22:28:37.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fe371541-aff7-462f-ac3a-d197ab49048f resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133022024-12-20T22:28:37.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fe371541-aff7-462f-ac3a-d197ab49048f response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133032024-12-20T22:28:38.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 623dabbf-4568-4957-bd3d-c8ceb0a684a7 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133042024-12-20T22:28:38.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 623dabbf-4568-4957-bd3d-c8ceb0a684a7 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133052024-12-20T22:28:38.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 623dabbf-4568-4957-bd3d-c8ceb0a684a7 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133062024-12-20T22:28:39.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 00a54261-4dd1-4cc5-bca3-ad0d4280af0b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133072024-12-20T22:28:39.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 00a54261-4dd1-4cc5-bca3-ad0d4280af0b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133082024-12-20T22:28:39.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 00a54261-4dd1-4cc5-bca3-ad0d4280af0b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133092024-12-20T22:28:40.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 984e4ab2-8ef5-48f7-85d2-5905d8f72dac roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133102024-12-20T22:28:40.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 984e4ab2-8ef5-48f7-85d2-5905d8f72dac resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133112024-12-20T22:28:40.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 984e4ab2-8ef5-48f7-85d2-5905d8f72dac response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133122024-12-20T22:28:41.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3083e3c2-9ee9-48d1-b8f7-0d8c3dfff303 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133132024-12-20T22:28:41.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3083e3c2-9ee9-48d1-b8f7-0d8c3dfff303 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133142024-12-20T22:28:41.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 3083e3c2-9ee9-48d1-b8f7-0d8c3dfff303 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133152024-12-20T22:28:42.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81481614-514e-4825-ad67-4a05152cbfd0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133162024-12-20T22:28:42.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81481614-514e-4825-ad67-4a05152cbfd0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133172024-12-20T22:28:42.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 81481614-514e-4825-ad67-4a05152cbfd0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
133182024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
133192024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
133202024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133212024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133222024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
133232024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
133242024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
133252024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
133262024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133272024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
133282024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133292024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
133302024-12-20T22:28:43.446ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
133312024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
133322024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133332024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
133342024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133352024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
133362024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133372024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
133382024-12-20T22:28:43.446ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
133392024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
133402024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
133412024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
133422024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133432024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
133442024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
133452024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
133462024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
133472024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
133482024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
133492024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
133502024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133512024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
133522024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
133532024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133542024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133552024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133562024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133572024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
133582024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133592024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
133602024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133612024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
133622024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
133632024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133642024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
133652024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
133662024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
133672024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
133682024-12-20T22:28:43.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133692024-12-20T22:28:43.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133702024-12-20T22:28:43.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133712024-12-20T22:28:43.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133722024-12-20T22:28:43.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133732024-12-20T22:28:43.450ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133742024-12-20T22:28:43.450ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.257733ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
133752024-12-20T22:28:43.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133762024-12-20T22:28:43.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133772024-12-20T22:28:43.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133782024-12-20T22:28:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133792024-12-20T22:28:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133802024-12-20T22:28:43.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133812024-12-20T22:28:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133822024-12-20T22:28:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133832024-12-20T22:28:43.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133842024-12-20T22:28:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133852024-12-20T22:28:43.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
133862024-12-20T22:28:43.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133872024-12-20T22:28:43.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133882024-12-20T22:28:43.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133892024-12-20T22:28:43.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133902024-12-20T22:28:43.457ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1750, tv_nsec: 381788952 } })
133912024-12-20T22:28:43.458ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
133922024-12-20T22:28:43.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
133932024-12-20T22:28:43.458ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
133942024-12-20T22:28:43.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
133952024-12-20T22:28:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
133962024-12-20T22:28:43.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133972024-12-20T22:28:43.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133982024-12-20T22:28:43.461ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.795938ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
133992024-12-20T22:28:43.462ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1750, tv_nsec: 386057215 } })
134002024-12-20T22:28:43.462ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
134012024-12-20T22:28:43.463ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.885219ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
134022024-12-20T22:28:43.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134032024-12-20T22:28:43.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134042024-12-20T22:28:43.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134052024-12-20T22:28:43.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134062024-12-20T22:28:43.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134072024-12-20T22:28:43.465ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134082024-12-20T22:28:43.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134092024-12-20T22:28:43.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
134102024-12-20T22:28:43.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134112024-12-20T22:28:43.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134122024-12-20T22:28:43.468ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134132024-12-20T22:28:43.469ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a0a780c3-0806-4044-8e4b-e91bf0405221.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1750, tv_nsec: 393774313 } })
134142024-12-20T22:28:43.470ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
134152024-12-20T22:28:43.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
134162024-12-20T22:28:43.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134172024-12-20T22:28:43.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134182024-12-20T22:28:43.495ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
134192024-12-20T22:28:43.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
134202024-12-20T22:28:43.498ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
134212024-12-20T22:28:43.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
134222024-12-20T22:28:43.499ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
134232024-12-20T22:28:43.499ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
134242024-12-20T22:28:43.499ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
134252024-12-20T22:28:43.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
134262024-12-20T22:28:43.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 53.856542ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
134272024-12-20T22:28:43.501ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
134282024-12-20T22:28:43.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
134292024-12-20T22:28:43.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134302024-12-20T22:28:43.503ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.828521ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
134312024-12-20T22:28:43.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134322024-12-20T22:28:43.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134332024-12-20T22:28:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134342024-12-20T22:28:43.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134352024-12-20T22:28:43.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
134362024-12-20T22:28:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
134372024-12-20T22:28:43.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.816192ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
134382024-12-20T22:28:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a0a780c3-0806-4044-8e4b-e91bf0405221, lookup_type: ById(a0a780c3-0806-4044-8e4b-e91bf0405221) } result = Ok(())
134392024-12-20T22:28:43.514ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134402024-12-20T22:28:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134412024-12-20T22:28:43.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.046245ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
134422024-12-20T22:28:43.516ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.958014ms iteration = 30 status = 0
134432024-12-20T22:28:43.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134442024-12-20T22:28:43.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
134452024-12-20T22:28:43.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134462024-12-20T22:28:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134472024-12-20T22:28:43.521ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
134482024-12-20T22:28:43.521ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.913424ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
134492024-12-20T22:28:43.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134502024-12-20T22:28:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134512024-12-20T22:28:43.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134522024-12-20T22:28:43.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134532024-12-20T22:28:43.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134542024-12-20T22:28:43.533ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
134552024-12-20T22:28:43.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134562024-12-20T22:28:43.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134572024-12-20T22:28:43.533ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
134582024-12-20T22:28:43.533ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
134592024-12-20T22:28:43.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
134602024-12-20T22:28:43.533ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
134612024-12-20T22:28:43.533ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.046987ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
134622024-12-20T22:28:43.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
134632024-12-20T22:28:43.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134642024-12-20T22:28:43.536ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
134652024-12-20T22:28:43.537ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134662024-12-20T22:28:43.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134672024-12-20T22:28:43.552ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
134682024-12-20T22:28:43.552ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
134692024-12-20T22:28:43.552ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03e607aa-255b-4d14-ad33-1dd27a9be494", "content-length": "26", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
134702024-12-20T22:28:43.552ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
134712024-12-20T22:28:43.554ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
134722024-12-20T22:28:43.556ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
134732024-12-20T22:28:43.556ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
134742024-12-20T22:28:43.556ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4920505a-d212-451f-b973-76fb670f8dec", "content-length": "26", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
134752024-12-20T22:28:43.556ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
134762024-12-20T22:28:43.558ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
134772024-12-20T22:28:43.560ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
134782024-12-20T22:28:43.560ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
134792024-12-20T22:28:43.560ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.22594ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
134802024-12-20T22:28:43.568ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 zone_address = fd00:1122:3344:101::2
134812024-12-20T22:28:43.568ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
134822024-12-20T22:28:43.568ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "489d152c-4c27-4054-8f4f-d677454f6542", "content-length": "26", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
134832024-12-20T22:28:43.568ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
134842024-12-20T22:28:43.570ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
134852024-12-20T22:28:43.581ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 135.045209ms iteration = 34 status = {"physical_disks_added":0}
134862024-12-20T22:28:43.696ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
134872024-12-20T22:28:43.697ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "418944bc-96d1-4f97-863a-8bc6b0fca25e", "content-length": "2", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
134882024-12-20T22:28:43.699ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
134892024-12-20T22:28:43.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
134902024-12-20T22:28:43.702ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 255.145898ms iteration = 30 status = null
134912024-12-20T22:28:43.790ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
134922024-12-20T22:28:43.791ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5048fcd-1ec0-425e-9a7a-909d9f9d5141", "content-length": "691", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
134932024-12-20T22:28:43.791ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
134942024-12-20T22:28:43.791ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
134952024-12-20T22:28:43.791ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
134962024-12-20T22:28:43.792ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 346.013893ms iteration = 31 status = {}
134972024-12-20T22:28:43.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 913b4d5f-eb64-49dd-9d22-405a24dc51d5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
134982024-12-20T22:28:43.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 913b4d5f-eb64-49dd-9d22-405a24dc51d5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
134992024-12-20T22:28:43.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 913b4d5f-eb64-49dd-9d22-405a24dc51d5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135002024-12-20T22:28:43.808ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 361.452987ms iteration = 30 status = {}
135012024-12-20T22:28:43.808ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
135022024-12-20T22:28:43.808ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
135032024-12-20T22:28:43.812ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b137d773-d873-416c-956d-299907c16609", "content-length": "372", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
135042024-12-20T22:28:43.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135052024-12-20T22:28:43.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135062024-12-20T22:28:43.858ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
135072024-12-20T22:28:43.858ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
135082024-12-20T22:28:43.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135092024-12-20T22:28:43.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135102024-12-20T22:28:43.883ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1dbfdd28-836e-4585-a189-a410d985cf48, rack_id: 5db885b5-a659-4fdd-980a-945a78ccaec1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9ca6d923-e4d1-4a65-8e7c-e3c8f123e087) } rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
135112024-12-20T22:28:43.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135122024-12-20T22:28:43.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135132024-12-20T22:28:43.891ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
135142024-12-20T22:28:43.891ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "afc1b9c4-a9f2-4652-9e09-e267adb28e01", "content-length": "134", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
135152024-12-20T22:28:43.891ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
135162024-12-20T22:28:43.891ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9ca6d923-e4d1-4a65-8e7c-e3c8f123e087
135172024-12-20T22:28:43.891ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
135182024-12-20T22:28:43.891ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
135192024-12-20T22:28:43.891ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135202024-12-20T22:28:43.891ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135212024-12-20T22:28:43.891ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135222024-12-20T22:28:43.891ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
135232024-12-20T22:28:43.892ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135242024-12-20T22:28:43.892ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
135252024-12-20T22:28:43.892ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1
135262024-12-20T22:28:43.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135272024-12-20T22:28:43.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135282024-12-20T22:28:43.894ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
135292024-12-20T22:28:43.894ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "93ad55a5-4fd8-457b-a34a-6d9eea11adf4", "content-length": "2", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
135302024-12-20T22:28:43.894ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
135312024-12-20T22:28:43.894ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "65c04268-04bb-403a-8a45-08fa8778f55f", "content-length": "52", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
135322024-12-20T22:28:43.894ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch_location = Switch0
135332024-12-20T22:28:43.894ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
135342024-12-20T22:28:43.933ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "43526362-42fc-4e7e-97f6-2f7cdc07beb9", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
135352024-12-20T22:28:43.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135362024-12-20T22:28:43.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135372024-12-20T22:28:43.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135382024-12-20T22:28:43.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135392024-12-20T22:28:43.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135402024-12-20T22:28:43.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135412024-12-20T22:28:43.941ZINFOnexus (BackgroundTasks): VPC route manager sled a0a780c3-0806-4044-8e4b-e91bf0405221 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
135422024-12-20T22:28:43.941ZDEBGnexus (BackgroundTasks): client request SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
135432024-12-20T22:28:43.942ZDEBGnexus (BackgroundTasks): client response SledAgent = a0a780c3-0806-4044-8e4b-e91bf0405221 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6bf504be-50d5-41de-88c6-9b1e41007d8f", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
135442024-12-20T22:28:43.944ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 497.336735ms iteration = 32 status = {}
135452024-12-20T22:28:44.028ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "90aa304d-0cdf-49d0-8a20-371cd14186c1", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
135462024-12-20T22:28:44.028ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 switch = Switch0
135472024-12-20T22:28:44.028ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
135482024-12-20T22:28:44.029ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5db885b5-a659-4fdd-980a-945a78ccaec1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc484d8a-a80d-4b6d-9ac8-14cac981c477", "content-length": "682", "date": "Fri, 20 Dec 2024 22:28:43 GMT"} })
135492024-12-20T22:28:44.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135502024-12-20T22:28:44.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135512024-12-20T22:28:44.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135522024-12-20T22:28:44.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135532024-12-20T22:28:44.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135542024-12-20T22:28:44.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135552024-12-20T22:28:44.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135562024-12-20T22:28:44.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135572024-12-20T22:28:44.045ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 598.720185ms iteration = 30 status = {}
135582024-12-20T22:28:44.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b1d5b701-0a5a-47db-b798-725f15c84b1b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135592024-12-20T22:28:44.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b1d5b701-0a5a-47db-b798-725f15c84b1b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135602024-12-20T22:28:44.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b1d5b701-0a5a-47db-b798-725f15c84b1b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135612024-12-20T22:28:45.692ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 9bffec66-489f-4bed-b86b-a7569f484463 response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
135622024-12-20T22:28:45.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dabdcfb0-2712-4d2e-8853-885ef4d38236 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135632024-12-20T22:28:45.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dabdcfb0-2712-4d2e-8853-885ef4d38236 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135642024-12-20T22:28:45.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = dabdcfb0-2712-4d2e-8853-885ef4d38236 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135652024-12-20T22:28:46.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fe2d90f8-4c97-43ff-a4e5-a15c8acef9a6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135662024-12-20T22:28:46.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fe2d90f8-4c97-43ff-a4e5-a15c8acef9a6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135672024-12-20T22:28:46.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = fe2d90f8-4c97-43ff-a4e5-a15c8acef9a6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135682024-12-20T22:28:47.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = abb19f46-a5b7-450e-a9b3-0863c06a716b roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135692024-12-20T22:28:47.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = abb19f46-a5b7-450e-a9b3-0863c06a716b resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135702024-12-20T22:28:47.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = abb19f46-a5b7-450e-a9b3-0863c06a716b response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135712024-12-20T22:28:48.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 65513a3e-d7dc-405d-86d1-06e7c582f2b6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
135722024-12-20T22:28:48.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 65513a3e-d7dc-405d-86d1-06e7c582f2b6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
135732024-12-20T22:28:48.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:64769 req_id = 65513a3e-d7dc-405d-86d1-06e7c582f2b6 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
135742024-12-20T22:28:48.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1c2bc3dc-a9e4-468f-b6bb-0fe7a653eb06 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135752024-12-20T22:28:48.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1c2bc3dc-a9e4-468f-b6bb-0fe7a653eb06 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135762024-12-20T22:28:48.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1c2bc3dc-a9e4-468f-b6bb-0fe7a653eb06 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135772024-12-20T22:28:49.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cbbd1870-b15f-45bb-be24-454c85a6b4a8 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135782024-12-20T22:28:49.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cbbd1870-b15f-45bb-be24-454c85a6b4a8 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135792024-12-20T22:28:49.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cbbd1870-b15f-45bb-be24-454c85a6b4a8 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135802024-12-20T22:28:50.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5d3c5ff2-86ac-4fb3-b970-222b56fd7bad roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135812024-12-20T22:28:50.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5d3c5ff2-86ac-4fb3-b970-222b56fd7bad resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135822024-12-20T22:28:50.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5d3c5ff2-86ac-4fb3-b970-222b56fd7bad response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135832024-12-20T22:28:51.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5467b9f4-ee1b-4fdc-b4a9-b9b8eb1a404c roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135842024-12-20T22:28:51.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5467b9f4-ee1b-4fdc-b4a9-b9b8eb1a404c resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135852024-12-20T22:28:51.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 5467b9f4-ee1b-4fdc-b4a9-b9b8eb1a404c response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135862024-12-20T22:28:52.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cb92bfa2-c7ac-4525-b5c4-1265b5717ca0 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135872024-12-20T22:28:52.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cb92bfa2-c7ac-4525-b5c4-1265b5717ca0 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135882024-12-20T22:28:53.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cb92bfa2-c7ac-4525-b5c4-1265b5717ca0 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
135892024-12-20T22:28:53.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
135902024-12-20T22:28:53.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
135912024-12-20T22:28:53.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135922024-12-20T22:28:53.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135932024-12-20T22:28:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135942024-12-20T22:28:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135952024-12-20T22:28:53.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135962024-12-20T22:28:53.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135972024-12-20T22:28:53.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135982024-12-20T22:28:53.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
135992024-12-20T22:28:53.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136002024-12-20T22:28:53.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136012024-12-20T22:28:53.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136022024-12-20T22:28:53.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136032024-12-20T22:28:53.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136042024-12-20T22:28:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
136052024-12-20T22:28:53.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136062024-12-20T22:28:53.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136072024-12-20T22:28:53.466ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
136082024-12-20T22:28:53.466ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.135623ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
136092024-12-20T22:28:53.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.287945ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
136102024-12-20T22:28:54.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ae222b35-1e2e-4356-b5ac-e15d2dddb3ac roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136112024-12-20T22:28:54.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ae222b35-1e2e-4356-b5ac-e15d2dddb3ac resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136122024-12-20T22:28:54.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = ae222b35-1e2e-4356-b5ac-e15d2dddb3ac response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136132024-12-20T22:28:55.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1c1e74b3-79e8-40a7-ab99-d9e3d9c26c48 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136142024-12-20T22:28:55.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1c1e74b3-79e8-40a7-ab99-d9e3d9c26c48 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136152024-12-20T22:28:55.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1c1e74b3-79e8-40a7-ab99-d9e3d9c26c48 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136162024-12-20T22:28:55.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d8137a02-b490-4bf8-b8fd-3b861618fcbd roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
136172024-12-20T22:28:55.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d8137a02-b490-4bf8-b8fd-3b861618fcbd resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
136182024-12-20T22:28:55.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = d8137a02-b490-4bf8-b8fd-3b861618fcbd response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?sort_by=id_ascending
136192024-12-20T22:28:55.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 5bf5aa04-0441-4278-891c-e15a2188ed84 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
136202024-12-20T22:28:55.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 5bf5aa04-0441-4278-891c-e15a2188ed84 resource = Database result = Ok(()) uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
136212024-12-20T22:28:55.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46218 req_id = 5bf5aa04-0441-4278-891c-e15a2188ed84 response_code = 200 uri = /metrics/collectors/5d539163-6f84-48f1-85f9-21095c2abbac/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjVlNDI1OS0yZTllLTQ1YjktOTMwNi1jY2UxNmJlOGUwNGIifX0%3D
136222024-12-20T22:28:55.692ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1484 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 0b3b8555-b881-47b8-ab0c-188e619e96cc response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c
136232024-12-20T22:28:56.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1736f0c1-261a-41af-b466-7c4ada6d93e2 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136242024-12-20T22:28:56.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1736f0c1-261a-41af-b466-7c4ada6d93e2 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136252024-12-20T22:28:56.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1736f0c1-261a-41af-b466-7c4ada6d93e2 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136262024-12-20T22:28:57.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0991d114-541b-47d2-be4f-0ce6afcf32d6 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136272024-12-20T22:28:57.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0991d114-541b-47d2-be4f-0ce6afcf32d6 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136282024-12-20T22:28:57.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 0991d114-541b-47d2-be4f-0ce6afcf32d6 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136292024-12-20T22:28:58.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8625e6fb-c115-448a-8c53-979872cb6fc5 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136302024-12-20T22:28:58.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8625e6fb-c115-448a-8c53-979872cb6fc5 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136312024-12-20T22:28:58.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 8625e6fb-c115-448a-8c53-979872cb6fc5 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136322024-12-20T22:28:59.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6a909f14-a770-4fe8-afcf-b1bf09eea706 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136332024-12-20T22:28:59.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6a909f14-a770-4fe8-afcf-b1bf09eea706 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136342024-12-20T22:28:59.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 6a909f14-a770-4fe8-afcf-b1bf09eea706 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136352024-12-20T22:29:00.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35dca25f-d4c2-472e-ab52-a64bf234f729 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136362024-12-20T22:29:00.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35dca25f-d4c2-472e-ab52-a64bf234f729 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136372024-12-20T22:29:00.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 35dca25f-d4c2-472e-ab52-a64bf234f729 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136382024-12-20T22:29:01.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 334e959e-1390-4edf-b0f5-7d05707bfd7a roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136392024-12-20T22:29:01.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 334e959e-1390-4edf-b0f5-7d05707bfd7a resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136402024-12-20T22:29:01.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 334e959e-1390-4edf-b0f5-7d05707bfd7a response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136412024-12-20T22:29:02.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cc845a78-7eb8-4d39-ab39-9a98b35f1713 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136422024-12-20T22:29:02.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cc845a78-7eb8-4d39-ab39-9a98b35f1713 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136432024-12-20T22:29:02.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = cc845a78-7eb8-4d39-ab39-9a98b35f1713 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136442024-12-20T22:29:03.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b542df93-a986-456f-a0d5-9731cb3d61ba roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136452024-12-20T22:29:03.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b542df93-a986-456f-a0d5-9731cb3d61ba resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136462024-12-20T22:29:03.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = b542df93-a986-456f-a0d5-9731cb3d61ba response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136472024-12-20T22:29:03.446ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
136482024-12-20T22:29:03.446ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
136492024-12-20T22:29:03.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136502024-12-20T22:29:03.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136512024-12-20T22:29:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136522024-12-20T22:29:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136532024-12-20T22:29:03.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136542024-12-20T22:29:03.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136552024-12-20T22:29:03.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136562024-12-20T22:29:03.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.534665ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
136572024-12-20T22:29:03.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
136582024-12-20T22:29:03.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136592024-12-20T22:29:03.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136602024-12-20T22:29:03.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136612024-12-20T22:29:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136622024-12-20T22:29:03.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136632024-12-20T22:29:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 61bbb56b-9acd-4cf3-97a8-a881969d15a3, lookup_type: ById(61bbb56b-9acd-4cf3-97a8-a881969d15a3) } result = Ok(())
136642024-12-20T22:29:03.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136652024-12-20T22:29:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136662024-12-20T22:29:03.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 original_time_created = 2024-12-20 22:14:00.126621 UTC target_id = 61bbb56b-9acd-4cf3-97a8-a881969d15a3 time_created = 2024-12-20 22:14:00.126621 UTC
136672024-12-20T22:29:03.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.475926ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"61bbb56b-9acd-4cf3-97a8-a881969d15a3","time_created":"2024-12-20T22:14:00.126621Z"}
136682024-12-20T22:29:04.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9d04ac43-7ca5-47c6-a49a-e87e87a69029 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136692024-12-20T22:29:04.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9d04ac43-7ca5-47c6-a49a-e87e87a69029 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136702024-12-20T22:29:04.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 9d04ac43-7ca5-47c6-a49a-e87e87a69029 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136712024-12-20T22:29:05.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1de86b43-ad9a-4566-9123-1c21274afc74 roles = RoleSet { roles: {} } uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136722024-12-20T22:29:05.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1de86b43-ad9a-4566-9123-1c21274afc74 resource = Database result = Ok(()) uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136732024-12-20T22:29:05.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43414 req_id = 1de86b43-ad9a-4566-9123-1c21274afc74 response_code = 200 uri = /probes/a0a780c3-0806-4044-8e4b-e91bf0405221
136742024-12-20T22:29:05.692ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1586 local_addr = [fd00:1122:3344:101::b]:62662 method = GET remote_addr = [fd00:1122:3344:101::d]:40610 req_id = 4b07915a-9e2f-43c3-9614-1b6e5ea986ec response_code = 200 uri = /73e5bc12-d8f1-466a-967d-9d6c8ff45a8c