Max level shown:
12024-11-27T18:45:02.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = fb607475-ef9b-4f66-8a51-c2ab10ab74b1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
22024-11-27T18:45:02.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = fb607475-ef9b-4f66-8a51-c2ab10ab74b1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
32024-11-27T18:45:02.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = fb607475-ef9b-4f66-8a51-c2ab10ab74b1 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
42024-11-27T18:45:03.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 05457bc7-6ec7-4fa7-b991-a61a4c4e476a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
52024-11-27T18:45:03.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 05457bc7-6ec7-4fa7-b991-a61a4c4e476a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
62024-11-27T18:45:03.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 05457bc7-6ec7-4fa7-b991-a61a4c4e476a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
72024-11-27T18:45:03.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 645 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = b1ab7bf2-0af0-4e91-9361-f2e89089ce96 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
82024-11-27T18:45:04.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 76c4fd57-3a22-48e2-853c-ef1dec01d176 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92024-11-27T18:45:04.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 76c4fd57-3a22-48e2-853c-ef1dec01d176 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
102024-11-27T18:45:04.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 76c4fd57-3a22-48e2-853c-ef1dec01d176 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112024-11-27T18:45:05.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = aad61d3a-2697-4537-bf1b-e4c887e92f53 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
122024-11-27T18:45:05.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = aad61d3a-2697-4537-bf1b-e4c887e92f53 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
132024-11-27T18:45:05.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = aad61d3a-2697-4537-bf1b-e4c887e92f53 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
142024-11-27T18:45:06.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c06d56e3-d506-4a4b-b061-df6d25f9c561 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
152024-11-27T18:45:06.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c06d56e3-d506-4a4b-b061-df6d25f9c561 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
162024-11-27T18:45:06.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c06d56e3-d506-4a4b-b061-df6d25f9c561 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
172024-11-27T18:45:07.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2db3eeed-9252-49b3-b675-64cfa4d70312 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
182024-11-27T18:45:07.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2db3eeed-9252-49b3-b675-64cfa4d70312 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
192024-11-27T18:45:07.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2db3eeed-9252-49b3-b675-64cfa4d70312 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
202024-11-27T18:45:08.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fdcb1e8f-439a-4e46-899e-51d9beeb607e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
212024-11-27T18:45:08.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fdcb1e8f-439a-4e46-899e-51d9beeb607e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
222024-11-27T18:45:08.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fdcb1e8f-439a-4e46-899e-51d9beeb607e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
232024-11-27T18:45:09.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d3e284a0-83ef-48f6-ab2e-e9579ca1c877 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
242024-11-27T18:45:09.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d3e284a0-83ef-48f6-ab2e-e9579ca1c877 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
252024-11-27T18:45:09.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d3e284a0-83ef-48f6-ab2e-e9579ca1c877 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
262024-11-27T18:45:10.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bbd53015-8f55-405d-bf72-4a1ee9c38e87 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
272024-11-27T18:45:10.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bbd53015-8f55-405d-bf72-4a1ee9c38e87 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
282024-11-27T18:45:10.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bbd53015-8f55-405d-bf72-4a1ee9c38e87 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
292024-11-27T18:45:11.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1d80a39c-5413-4962-a123-bca3ae75260e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
302024-11-27T18:45:11.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1d80a39c-5413-4962-a123-bca3ae75260e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
312024-11-27T18:45:11.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1d80a39c-5413-4962-a123-bca3ae75260e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
322024-11-27T18:45:11.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
332024-11-27T18:45:11.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
342024-11-27T18:45:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
352024-11-27T18:45:11.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
362024-11-27T18:45:11.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
372024-11-27T18:45:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
382024-11-27T18:45:11.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
392024-11-27T18:45:11.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
402024-11-27T18:45:11.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
412024-11-27T18:45:11.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
422024-11-27T18:45:11.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
432024-11-27T18:45:11.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
442024-11-27T18:45:11.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
452024-11-27T18:45:11.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
462024-11-27T18:45:11.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
472024-11-27T18:45:11.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
482024-11-27T18:45:11.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
492024-11-27T18:45:11.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
502024-11-27T18:45:11.440ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
512024-11-27T18:45:11.440ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.712028ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
522024-11-27T18:45:11.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.534293ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
532024-11-27T18:45:12.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4f67184-a0c5-4453-b858-07dc6621d370 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
542024-11-27T18:45:12.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4f67184-a0c5-4453-b858-07dc6621d370 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
552024-11-27T18:45:12.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4f67184-a0c5-4453-b858-07dc6621d370 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
562024-11-27T18:45:13.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e7cfcd1d-a653-47a2-8049-1ec5cbefc076 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
572024-11-27T18:45:13.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e7cfcd1d-a653-47a2-8049-1ec5cbefc076 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
582024-11-27T18:45:13.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e7cfcd1d-a653-47a2-8049-1ec5cbefc076 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
592024-11-27T18:45:13.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 583 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 9ca86585-535b-4cb1-8a26-ac3f6f47e8cd response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
602024-11-27T18:45:14.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 05c6a1ac-c37d-48f5-9f9e-98da7f84886a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
612024-11-27T18:45:14.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 05c6a1ac-c37d-48f5-9f9e-98da7f84886a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
622024-11-27T18:45:14.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 05c6a1ac-c37d-48f5-9f9e-98da7f84886a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
632024-11-27T18:45:15.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 47ffee68-31f8-4366-a7e0-83a77f7db98e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
642024-11-27T18:45:15.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 47ffee68-31f8-4366-a7e0-83a77f7db98e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
652024-11-27T18:45:15.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 47ffee68-31f8-4366-a7e0-83a77f7db98e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
662024-11-27T18:45:16.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0658b7a8-5fff-4679-95b8-48914b7a7c17 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
672024-11-27T18:45:16.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0658b7a8-5fff-4679-95b8-48914b7a7c17 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
682024-11-27T18:45:16.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0658b7a8-5fff-4679-95b8-48914b7a7c17 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
692024-11-27T18:45:17.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 49e870af-6789-49cd-bb7f-cb816a6d6d3d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
702024-11-27T18:45:17.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 49e870af-6789-49cd-bb7f-cb816a6d6d3d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
712024-11-27T18:45:17.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 49e870af-6789-49cd-bb7f-cb816a6d6d3d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
722024-11-27T18:45:18.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8fddebc1-1484-41a9-bc04-ab3c02471e43 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
732024-11-27T18:45:18.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8fddebc1-1484-41a9-bc04-ab3c02471e43 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
742024-11-27T18:45:18.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8fddebc1-1484-41a9-bc04-ab3c02471e43 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
752024-11-27T18:45:19.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = debc136e-8e35-4d89-8e7f-f633d0165b85 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
762024-11-27T18:45:19.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = debc136e-8e35-4d89-8e7f-f633d0165b85 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
772024-11-27T18:45:19.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = debc136e-8e35-4d89-8e7f-f633d0165b85 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
782024-11-27T18:45:20.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a9393ba-38b9-4c1f-b0f0-d4a68f55c629 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
792024-11-27T18:45:20.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a9393ba-38b9-4c1f-b0f0-d4a68f55c629 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
802024-11-27T18:45:20.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a9393ba-38b9-4c1f-b0f0-d4a68f55c629 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
812024-11-27T18:45:21.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
822024-11-27T18:45:21.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
832024-11-27T18:45:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
842024-11-27T18:45:21.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
852024-11-27T18:45:21.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
862024-11-27T18:45:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
872024-11-27T18:45:21.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
882024-11-27T18:45:21.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
892024-11-27T18:45:21.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c8bfd0ab-4258-4528-98f1-18b07570573f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
902024-11-27T18:45:21.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c8bfd0ab-4258-4528-98f1-18b07570573f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
912024-11-27T18:45:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
922024-11-27T18:45:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
932024-11-27T18:45:21.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
942024-11-27T18:45:21.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c8bfd0ab-4258-4528-98f1-18b07570573f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
952024-11-27T18:45:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
962024-11-27T18:45:21.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
972024-11-27T18:45:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
982024-11-27T18:45:21.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
992024-11-27T18:45:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
1002024-11-27T18:45:21.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1012024-11-27T18:45:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1022024-11-27T18:45:21.415ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
1032024-11-27T18:45:21.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.086358ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
1042024-11-27T18:45:21.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.98567ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1052024-11-27T18:45:22.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c616913-1b11-4594-8272-fbd10cc737ea roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1062024-11-27T18:45:22.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c616913-1b11-4594-8272-fbd10cc737ea resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1072024-11-27T18:45:22.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c616913-1b11-4594-8272-fbd10cc737ea response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1082024-11-27T18:45:23.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8ad69209-c4d7-48e2-9e7a-261ad7bbf48a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1092024-11-27T18:45:23.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8ad69209-c4d7-48e2-9e7a-261ad7bbf48a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1102024-11-27T18:45:23.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8ad69209-c4d7-48e2-9e7a-261ad7bbf48a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1112024-11-27T18:45:23.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 622 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 7b66ceda-e38c-4386-8230-f19101680b3f response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
1122024-11-27T18:45:24.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ab924f56-f048-489e-ae12-037917d00ff7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1132024-11-27T18:45:24.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ab924f56-f048-489e-ae12-037917d00ff7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1142024-11-27T18:45:24.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ab924f56-f048-489e-ae12-037917d00ff7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1152024-11-27T18:45:25.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7922dc0d-7e75-4e6c-967e-568b90301c0e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1162024-11-27T18:45:25.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7922dc0d-7e75-4e6c-967e-568b90301c0e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1172024-11-27T18:45:25.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7922dc0d-7e75-4e6c-967e-568b90301c0e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1182024-11-27T18:45:26.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb8e6b44-2fd8-4612-b905-c04337a25982 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1192024-11-27T18:45:26.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb8e6b44-2fd8-4612-b905-c04337a25982 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1202024-11-27T18:45:26.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb8e6b44-2fd8-4612-b905-c04337a25982 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1212024-11-27T18:45:27.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0babbcd1-1049-4957-a0cd-02aff879338d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1222024-11-27T18:45:27.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0babbcd1-1049-4957-a0cd-02aff879338d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1232024-11-27T18:45:27.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0babbcd1-1049-4957-a0cd-02aff879338d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1242024-11-27T18:45:28.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72e3879f-3149-4332-956f-7861e0bb655d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1252024-11-27T18:45:28.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72e3879f-3149-4332-956f-7861e0bb655d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1262024-11-27T18:45:28.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72e3879f-3149-4332-956f-7861e0bb655d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1272024-11-27T18:45:29.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be044c63-69ea-4f2f-a956-4700b7df5658 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1282024-11-27T18:45:29.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be044c63-69ea-4f2f-a956-4700b7df5658 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1292024-11-27T18:45:29.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be044c63-69ea-4f2f-a956-4700b7df5658 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1302024-11-27T18:45:30.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5f5e00b-cd94-4474-9c7c-bdf5622d10d7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1312024-11-27T18:45:30.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5f5e00b-cd94-4474-9c7c-bdf5622d10d7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1322024-11-27T18:45:30.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5f5e00b-cd94-4474-9c7c-bdf5622d10d7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
1332024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
1342024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
1352024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1362024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1372024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
1382024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
1392024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1402024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1412024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
1422024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
1432024-11-27T18:45:31.393ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
1442024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.37\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
1452024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
1462024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
1472024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1482024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1492024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
1502024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
1512024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
1522024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1532024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
1542024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1552024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1562024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1572024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
1582024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1592024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1602024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
1612024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1622024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
1632024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
1642024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1652024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
1662024-11-27T18:45:31.393ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:35:31.393382517 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1672024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1682024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
1692024-11-27T18:45:31.393ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1702024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1712024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
1722024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
1732024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1742024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1752024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
1762024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
1772024-11-27T18:45:31.393ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1782024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1792024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
1802024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1812024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1822024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
1832024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1842024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
1852024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1862024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
1872024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1882024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
1892024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1902024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
1912024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
1922024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1932024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
1942024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1952024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1962024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1972024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1982024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1992024-11-27T18:45:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2002024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2012024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
2022024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2032024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2042024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2052024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2062024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2072024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2082024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2092024-11-27T18:45:31.394ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2765, tv_nsec: 389675045 } })
2102024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2112024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2122024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2132024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2142024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2152024-11-27T18:45:31.394ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2765, tv_nsec: 389733836 } })
2162024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2172024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2182024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
2192024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2202024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2212024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
2222024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.401171ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
2232024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
2242024-11-27T18:45:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.185537ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
2252024-11-27T18:45:31.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2262024-11-27T18:45:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2272024-11-27T18:45:31.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2282024-11-27T18:45:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2292024-11-27T18:45:31.397ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.243313ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2302024-11-27T18:45:31.399ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2765, tv_nsec: 395064255 } })
2312024-11-27T18:45:31.399ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
2322024-11-27T18:45:31.405ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.593692ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
2332024-11-27T18:45:31.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2765, tv_nsec: 401197945 } })
2342024-11-27T18:45:31.405ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
2352024-11-27T18:45:31.407ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:35:31.393382517 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2362024-11-27T18:45:31.407ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.848785ms iteration = 12 status = {"expiration":"2024-11-27T18:35:31.393382517Z","pruned":[]}
2372024-11-27T18:45:31.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.294237ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
2382024-11-27T18:45:31.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2392024-11-27T18:45:31.433ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2402024-11-27T18:45:31.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2412024-11-27T18:45:31.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.013458ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
2422024-11-27T18:45:31.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2432024-11-27T18:45:31.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2442024-11-27T18:45:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2452024-11-27T18:45:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2462024-11-27T18:45:31.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2472024-11-27T18:45:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2482024-11-27T18:45:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2492024-11-27T18:45:31.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2502024-11-27T18:45:31.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2512024-11-27T18:45:31.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2522024-11-27T18:45:31.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2532024-11-27T18:45:31.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2542024-11-27T18:45:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2552024-11-27T18:45:31.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2562024-11-27T18:45:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2572024-11-27T18:45:31.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2582024-11-27T18:45:31.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2592024-11-27T18:45:31.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2602024-11-27T18:45:31.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
2612024-11-27T18:45:31.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2622024-11-27T18:45:31.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2632024-11-27T18:45:31.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2642024-11-27T18:45:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2652024-11-27T18:45:31.460ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2662024-11-27T18:45:31.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2672024-11-27T18:45:31.461ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2682024-11-27T18:45:31.462ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2692024-11-27T18:45:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2702024-11-27T18:45:31.462ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2712024-11-27T18:45:31.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2722024-11-27T18:45:31.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2732024-11-27T18:45:31.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2742024-11-27T18:45:31.463ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2752024-11-27T18:45:31.463ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2762024-11-27T18:45:31.463ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2772024-11-27T18:45:31.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2782024-11-27T18:45:31.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2792024-11-27T18:45:31.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2802024-11-27T18:45:31.465ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2812024-11-27T18:45:31.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2822024-11-27T18:45:31.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2832024-11-27T18:45:31.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2842024-11-27T18:45:31.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2852024-11-27T18:45:31.468ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2862024-11-27T18:45:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2872024-11-27T18:45:31.468ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2882024-11-27T18:45:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2892024-11-27T18:45:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2902024-11-27T18:45:31.469ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2912024-11-27T18:45:31.469ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2922024-11-27T18:45:31.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2932024-11-27T18:45:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2942024-11-27T18:45:31.470ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2952024-11-27T18:45:31.471ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
2962024-11-27T18:45:31.471ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.797933ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
2972024-11-27T18:45:31.471ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2765, tv_nsec: 466994201 } })
2982024-11-27T18:45:31.471ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
2992024-11-27T18:45:31.472ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3002024-11-27T18:45:31.472ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3012024-11-27T18:45:31.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
3022024-11-27T18:45:31.472ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3032024-11-27T18:45:31.472ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
3042024-11-27T18:45:31.472ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
3052024-11-27T18:45:31.472ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.144224ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
3062024-11-27T18:45:31.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3072024-11-27T18:45:31.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3082024-11-27T18:45:31.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3092024-11-27T18:45:31.475ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3102024-11-27T18:45:31.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3112024-11-27T18:45:31.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3122024-11-27T18:45:31.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3132024-11-27T18:45:31.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3142024-11-27T18:45:31.477ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3152024-11-27T18:45:31.478ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3162024-11-27T18:45:31.478ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3172024-11-27T18:45:31.478ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3182024-11-27T18:45:31.478ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3192024-11-27T18:45:31.478ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3202024-11-27T18:45:31.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3212024-11-27T18:45:31.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3222024-11-27T18:45:31.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3232024-11-27T18:45:31.480ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3242024-11-27T18:45:31.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3252024-11-27T18:45:31.481ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3262024-11-27T18:45:31.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3272024-11-27T18:45:31.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3282024-11-27T18:45:31.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3292024-11-27T18:45:31.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3302024-11-27T18:45:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3312024-11-27T18:45:31.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3322024-11-27T18:45:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3332024-11-27T18:45:31.489ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3342024-11-27T18:45:31.489ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3352024-11-27T18:45:31.489ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3362024-11-27T18:45:31.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3372024-11-27T18:45:31.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3382024-11-27T18:45:31.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3392024-11-27T18:45:31.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3402024-11-27T18:45:31.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3412024-11-27T18:45:31.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.692752ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3422024-11-27T18:45:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3432024-11-27T18:45:31.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3442024-11-27T18:45:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3452024-11-27T18:45:31.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.651746ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3462024-11-27T18:45:31.508ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3472024-11-27T18:45:31.508ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3482024-11-27T18:45:31.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3492024-11-27T18:45:31.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3502024-11-27T18:45:31.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3512024-11-27T18:45:31.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3522024-11-27T18:45:31.512ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3532024-11-27T18:45:31.512ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.576267ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3542024-11-27T18:45:31.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3552024-11-27T18:45:31.520ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3562024-11-27T18:45:31.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
3572024-11-27T18:45:31.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3582024-11-27T18:45:31.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3592024-11-27T18:45:31.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3602024-11-27T18:45:31.521ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3612024-11-27T18:45:31.521ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3622024-11-27T18:45:31.521ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 128.233661ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3632024-11-27T18:45:31.523ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 130.631376ms iteration = 23 status = 0
3642024-11-27T18:45:31.524ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3652024-11-27T18:45:31.524ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3662024-11-27T18:45:31.525ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87cc49d6-674b-4b2b-92b6-e0a011e3dc00", "content-length": "26", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
3672024-11-27T18:45:31.525ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3682024-11-27T18:45:31.526ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3692024-11-27T18:45:31.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 135.869634ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3702024-11-27T18:45:31.538ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3712024-11-27T18:45:31.538ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
3722024-11-27T18:45:31.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3732024-11-27T18:45:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3742024-11-27T18:45:31.539ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3752024-11-27T18:45:31.539ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3762024-11-27T18:45:31.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3772024-11-27T18:45:31.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3782024-11-27T18:45:31.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3792024-11-27T18:45:31.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3802024-11-27T18:45:31.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3812024-11-27T18:45:31.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3822024-11-27T18:45:31.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3832024-11-27T18:45:31.544ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3842024-11-27T18:45:31.544ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
3852024-11-27T18:45:31.544ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3862024-11-27T18:45:31.544ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
3872024-11-27T18:45:31.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 151.640458ms iteration = 12 status = {"generation":2}
3882024-11-27T18:45:31.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3892024-11-27T18:45:31.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3902024-11-27T18:45:31.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3912024-11-27T18:45:31.547ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3922024-11-27T18:45:31.547ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3932024-11-27T18:45:31.547ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.588877ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3942024-11-27T18:45:31.549ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3952024-11-27T18:45:31.549ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3962024-11-27T18:45:31.549ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
3972024-11-27T18:45:31.549ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 156.405688ms iteration = 12 status = {"generation":1}
3982024-11-27T18:45:31.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 156.48851ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3992024-11-27T18:45:31.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4002024-11-27T18:45:31.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4012024-11-27T18:45:31.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4022024-11-27T18:45:31.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4032024-11-27T18:45:31.600ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 206.648703ms iteration = 26 status = {"physical_disks_added":0}
4042024-11-27T18:45:31.605ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4052024-11-27T18:45:31.605ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 212.282546ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4062024-11-27T18:45:31.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4072024-11-27T18:45:31.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4082024-11-27T18:45:31.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4092024-11-27T18:45:31.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fac27c05-965d-4110-ad80-1b496ef1e367 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
4102024-11-27T18:45:31.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fac27c05-965d-4110-ad80-1b496ef1e367 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
4112024-11-27T18:45:31.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4122024-11-27T18:45:31.611ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4132024-11-27T18:45:31.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4142024-11-27T18:45:31.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fac27c05-965d-4110-ad80-1b496ef1e367 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
4152024-11-27T18:45:31.631ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
4162024-11-27T18:45:31.631ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 238.191041ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4172024-11-27T18:45:31.644ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
4182024-11-27T18:45:31.644ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4192024-11-27T18:45:31.645ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a6814c2-97f3-451c-8d75-2a2177e9df8e", "content-length": "26", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
4202024-11-27T18:45:31.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4212024-11-27T18:45:31.646ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
4222024-11-27T18:45:31.647ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4232024-11-27T18:45:31.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4242024-11-27T18:45:31.649ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4252024-11-27T18:45:31.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4262024-11-27T18:45:31.674ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4272024-11-27T18:45:31.684ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 291.609333ms iteration = 23 status = {}
4282024-11-27T18:45:31.700ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
4292024-11-27T18:45:31.700ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4302024-11-27T18:45:31.700ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "df3fbf7c-3e6b-4c6d-af78-de887ea13fba", "content-length": "26", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
4312024-11-27T18:45:31.700ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4322024-11-27T18:45:31.702ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4332024-11-27T18:45:31.820ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4342024-11-27T18:45:31.820ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4352024-11-27T18:45:31.821ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a531b41-3475-4d00-bcc8-e9431af1e659", "content-length": "372", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
4362024-11-27T18:45:31.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4372024-11-27T18:45:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4382024-11-27T18:45:31.836ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4392024-11-27T18:45:31.836ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ac4ccd4f-09ff-4dfe-b935-a0e9c341f515", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4402024-11-27T18:45:31.836ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4412024-11-27T18:45:31.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4422024-11-27T18:45:31.838ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a8e4621c-4a5a-47ec-b8a2-10e135b148aa", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4432024-11-27T18:45:31.838ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4442024-11-27T18:45:31.840ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4452024-11-27T18:45:31.840ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 446.860903ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4462024-11-27T18:45:31.852ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4472024-11-27T18:45:31.853ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "97411cc1-8cad-49cf-b903-e279e2fda37d", "content-length": "1", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
4482024-11-27T18:45:31.854ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4492024-11-27T18:45:31.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4502024-11-27T18:45:31.857ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 463.743713ms iteration = 23 status = null
4512024-11-27T18:45:31.862ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
4522024-11-27T18:45:31.862ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4532024-11-27T18:45:31.862ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e81226d1-5689-463d-8fa1-1585db0bd3bc", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
4542024-11-27T18:45:31.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4552024-11-27T18:45:31.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4562024-11-27T18:45:31.863ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4572024-11-27T18:45:31.863ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "389fd2d5-831a-4ba1-8bd8-7a86b5d5e1f8", "content-length": "691", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
4582024-11-27T18:45:31.863ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
4592024-11-27T18:45:31.863ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4602024-11-27T18:45:31.863ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
4612024-11-27T18:45:31.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4622024-11-27T18:45:31.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4632024-11-27T18:45:31.865ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 472.398262ms iteration = 23 status = {}
4642024-11-27T18:45:31.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4652024-11-27T18:45:31.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4662024-11-27T18:45:31.871ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4672024-11-27T18:45:31.871ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4682024-11-27T18:45:31.872ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1b678eab-5748-4970-8b68-209eba4e6966", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
4692024-11-27T18:45:31.874ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 480.691445ms iteration = 23 status = {}
4702024-11-27T18:45:31.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 956e6d6e-c5d3-449c-9f54-1b4d9f5d068d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
4712024-11-27T18:45:31.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 956e6d6e-c5d3-449c-9f54-1b4d9f5d068d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
4722024-11-27T18:45:31.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 956e6d6e-c5d3-449c-9f54-1b4d9f5d068d response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
4732024-11-27T18:45:31.900ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4742024-11-27T18:45:31.900ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a2242737-6fe8-4033-89f3-c0cdee82e5f6", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4752024-11-27T18:45:31.900ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4762024-11-27T18:45:31.902ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b84ebf08-b4f3-417c-b045-89840af8033d", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4772024-11-27T18:45:31.902ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4782024-11-27T18:45:31.903ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "76fa8d38-dd3c-4508-b324-4838404b3832", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4792024-11-27T18:45:31.903ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4802024-11-27T18:45:31.905ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4812024-11-27T18:45:31.906ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 512.583687ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4822024-11-27T18:45:31.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4832024-11-27T18:45:31.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4842024-11-27T18:45:31.926ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
4852024-11-27T18:45:31.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4862024-11-27T18:45:31.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4872024-11-27T18:45:31.936ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4882024-11-27T18:45:31.936ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d95d841-6b6f-4bdf-9ccb-1cfa2c3ceb65", "content-length": "134", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
4892024-11-27T18:45:31.936ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4902024-11-27T18:45:31.936ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
4912024-11-27T18:45:31.937ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4922024-11-27T18:45:31.937ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4932024-11-27T18:45:31.937ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4942024-11-27T18:45:31.937ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4952024-11-27T18:45:31.937ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4962024-11-27T18:45:31.937ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4972024-11-27T18:45:31.937ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4982024-11-27T18:45:31.937ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4992024-11-27T18:45:31.937ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
5002024-11-27T18:45:31.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5012024-11-27T18:45:31.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5022024-11-27T18:45:31.939ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5032024-11-27T18:45:31.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "79efac7f-7bea-48de-9814-f27d5002523e", "content-length": "2", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
5042024-11-27T18:45:31.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5052024-11-27T18:45:31.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7c07bea-b348-4a0c-a756-c33b3fa8a8c6", "content-length": "52", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
5062024-11-27T18:45:31.940ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
5072024-11-27T18:45:31.940ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5082024-11-27T18:45:32.066ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "07c19be3-1325-4904-afa8-f16d9b8daab8", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
5092024-11-27T18:45:32.066ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
5102024-11-27T18:45:32.066ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5112024-11-27T18:45:32.067ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b107e721-64f1-4ee1-ac8d-d15943e6daa6", "content-length": "682", "date": "Wed, 27 Nov 2024 18:45:32 GMT"} })
5122024-11-27T18:45:32.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5132024-11-27T18:45:32.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5142024-11-27T18:45:32.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5152024-11-27T18:45:32.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5162024-11-27T18:45:32.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5172024-11-27T18:45:32.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5182024-11-27T18:45:32.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5192024-11-27T18:45:32.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5202024-11-27T18:45:32.093ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 699.860544ms iteration = 23 status = {}
5212024-11-27T18:45:32.172ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
5222024-11-27T18:45:32.172ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
5232024-11-27T18:45:32.203ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
5242024-11-27T18:45:32.203ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:55212
5252024-11-27T18:45:32.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55212 req_id = aadd1ee8-944f-4231-ab1c-92c2a0328dbb roles = RoleSet { roles: {} } uri = /metrics/producers
5262024-11-27T18:45:32.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55212 req_id = aadd1ee8-944f-4231-ab1c-92c2a0328dbb resource = Database result = Ok(()) uri = /metrics/producers
5272024-11-27T18:45:32.240ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 236c7b74-8315-46e3-9a37-90380a675558
5282024-11-27T18:45:32.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36896 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55212 req_id = aadd1ee8-944f-4231-ab1c-92c2a0328dbb response_code = 201 uri = /metrics/producers
5292024-11-27T18:45:32.240ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "aadd1ee8-944f-4231-ab1c-92c2a0328dbb", "content-length": "41", "date": "Wed, 27 Nov 2024 18:45:31 GMT"} })
5302024-11-27T18:45:32.241ZDEBGnexus (producer-registration-task): registered with nexus successfully
5312024-11-27T18:45:32.241ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
5322024-11-27T18:45:32.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 996d644a-40ce-43f4-ade8-e38a5d1d4880 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5332024-11-27T18:45:32.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 996d644a-40ce-43f4-ade8-e38a5d1d4880 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5342024-11-27T18:45:32.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 996d644a-40ce-43f4-ade8-e38a5d1d4880 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5352024-11-27T18:45:33.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 522 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = b15a7b03-507c-429a-8ce5-e88478e7868e response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
5362024-11-27T18:45:33.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 53f66194-8bb8-4169-b14b-66fb103e1ad9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5372024-11-27T18:45:33.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 53f66194-8bb8-4169-b14b-66fb103e1ad9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5382024-11-27T18:45:33.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 53f66194-8bb8-4169-b14b-66fb103e1ad9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5392024-11-27T18:45:34.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 81c6d057-5247-4f6a-8b61-f56d29c011d5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5402024-11-27T18:45:34.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 81c6d057-5247-4f6a-8b61-f56d29c011d5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5412024-11-27T18:45:34.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 81c6d057-5247-4f6a-8b61-f56d29c011d5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5422024-11-27T18:45:35.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a882099-2134-4be8-b815-dea7867311d7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5432024-11-27T18:45:35.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a882099-2134-4be8-b815-dea7867311d7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5442024-11-27T18:45:35.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a882099-2134-4be8-b815-dea7867311d7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5452024-11-27T18:45:36.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a417afa-d809-4d54-9584-3c7d105a94aa roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5462024-11-27T18:45:36.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a417afa-d809-4d54-9584-3c7d105a94aa resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5472024-11-27T18:45:36.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a417afa-d809-4d54-9584-3c7d105a94aa response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5482024-11-27T18:45:37.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a888f27d-76b8-4f34-bee7-2ade3f158b0c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5492024-11-27T18:45:37.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a888f27d-76b8-4f34-bee7-2ade3f158b0c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5502024-11-27T18:45:37.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a888f27d-76b8-4f34-bee7-2ade3f158b0c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5512024-11-27T18:45:38.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6490c981-b63e-4b91-b3d2-85725af1ca97 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5522024-11-27T18:45:38.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6490c981-b63e-4b91-b3d2-85725af1ca97 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5532024-11-27T18:45:38.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6490c981-b63e-4b91-b3d2-85725af1ca97 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5542024-11-27T18:45:39.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 26335bdd-98dc-4adb-ace8-dc26ab0946fb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5552024-11-27T18:45:39.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 26335bdd-98dc-4adb-ace8-dc26ab0946fb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5562024-11-27T18:45:39.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 26335bdd-98dc-4adb-ace8-dc26ab0946fb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5572024-11-27T18:45:40.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9696bdb5-b1bd-4d4c-9328-85647352e1b0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5582024-11-27T18:45:40.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9696bdb5-b1bd-4d4c-9328-85647352e1b0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5592024-11-27T18:45:40.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9696bdb5-b1bd-4d4c-9328-85647352e1b0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5602024-11-27T18:45:41.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
5612024-11-27T18:45:41.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5622024-11-27T18:45:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5632024-11-27T18:45:41.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
5642024-11-27T18:45:41.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5652024-11-27T18:45:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5662024-11-27T18:45:41.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-11-27T18:45:41.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5682024-11-27T18:45:41.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5692024-11-27T18:45:41.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.503502ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5702024-11-27T18:45:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5712024-11-27T18:45:41.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5722024-11-27T18:45:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5732024-11-27T18:45:41.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5742024-11-27T18:45:41.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5752024-11-27T18:45:41.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762024-11-27T18:45:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
5772024-11-27T18:45:41.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5782024-11-27T18:45:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5792024-11-27T18:45:41.411ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
5802024-11-27T18:45:41.411ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.695417ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
5812024-11-27T18:45:41.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a756df8f-ce3a-4bf5-9f45-696c74a07192 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5822024-11-27T18:45:41.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a756df8f-ce3a-4bf5-9f45-696c74a07192 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5832024-11-27T18:45:41.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a756df8f-ce3a-4bf5-9f45-696c74a07192 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5842024-11-27T18:45:42.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4295caec-4731-49e7-bbbb-774f38f35d23 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5852024-11-27T18:45:42.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4295caec-4731-49e7-bbbb-774f38f35d23 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5862024-11-27T18:45:42.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4295caec-4731-49e7-bbbb-774f38f35d23 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5872024-11-27T18:45:43.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 513 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 1ca0a37f-8d4c-46b0-9763-a7bb53d36ecd response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
5882024-11-27T18:45:43.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = efc312ea-d9d4-40ad-90df-87ac57797496 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5892024-11-27T18:45:43.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = efc312ea-d9d4-40ad-90df-87ac57797496 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5902024-11-27T18:45:43.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = efc312ea-d9d4-40ad-90df-87ac57797496 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5912024-11-27T18:45:44.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b8fb411e-58c0-4d52-a862-26f8470b6cfa roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5922024-11-27T18:45:44.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b8fb411e-58c0-4d52-a862-26f8470b6cfa resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5932024-11-27T18:45:44.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b8fb411e-58c0-4d52-a862-26f8470b6cfa response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5942024-11-27T18:45:45.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 99a6ff6c-e298-421a-b721-0acac1fc9a64 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5952024-11-27T18:45:45.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 99a6ff6c-e298-421a-b721-0acac1fc9a64 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5962024-11-27T18:45:45.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 99a6ff6c-e298-421a-b721-0acac1fc9a64 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5972024-11-27T18:45:46.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 10503a03-27ae-460f-9e6d-a5e2cf5e7c8c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5982024-11-27T18:45:46.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 10503a03-27ae-460f-9e6d-a5e2cf5e7c8c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
5992024-11-27T18:45:46.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 10503a03-27ae-460f-9e6d-a5e2cf5e7c8c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6002024-11-27T18:45:47.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dca6c65e-ad45-42d5-a8e4-aae867cb630e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6012024-11-27T18:45:47.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dca6c65e-ad45-42d5-a8e4-aae867cb630e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6022024-11-27T18:45:47.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dca6c65e-ad45-42d5-a8e4-aae867cb630e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6032024-11-27T18:45:48.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07714c03-cf6a-4517-981d-e09e91edb649 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6042024-11-27T18:45:48.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07714c03-cf6a-4517-981d-e09e91edb649 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6052024-11-27T18:45:48.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07714c03-cf6a-4517-981d-e09e91edb649 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6062024-11-27T18:45:50.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6701a56b-7586-4b05-b4a7-aa3141757a01 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6072024-11-27T18:45:50.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6701a56b-7586-4b05-b4a7-aa3141757a01 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6082024-11-27T18:45:50.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6701a56b-7586-4b05-b4a7-aa3141757a01 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6092024-11-27T18:45:51.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e971ae9a-b72e-496d-a7e4-8cd93e6cfdf9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6102024-11-27T18:45:51.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e971ae9a-b72e-496d-a7e4-8cd93e6cfdf9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6112024-11-27T18:45:51.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e971ae9a-b72e-496d-a7e4-8cd93e6cfdf9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6122024-11-27T18:45:51.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
6132024-11-27T18:45:51.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6142024-11-27T18:45:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6152024-11-27T18:45:51.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
6162024-11-27T18:45:51.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6172024-11-27T18:45:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6182024-11-27T18:45:51.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6192024-11-27T18:45:51.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6202024-11-27T18:45:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6212024-11-27T18:45:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6222024-11-27T18:45:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6232024-11-27T18:45:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6242024-11-27T18:45:51.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6252024-11-27T18:45:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6262024-11-27T18:45:51.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6272024-11-27T18:45:51.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
6282024-11-27T18:45:51.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6292024-11-27T18:45:51.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6302024-11-27T18:45:51.415ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
6312024-11-27T18:45:51.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.251979ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
6322024-11-27T18:45:51.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.803777ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6332024-11-27T18:45:52.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 014f2429-7575-484c-9ae5-a75f82bb6850 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6342024-11-27T18:45:52.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 014f2429-7575-484c-9ae5-a75f82bb6850 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6352024-11-27T18:45:52.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 014f2429-7575-484c-9ae5-a75f82bb6850 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6362024-11-27T18:45:53.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c77d2ef9-2a44-4f0d-9536-78156484e3a4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6372024-11-27T18:45:53.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c77d2ef9-2a44-4f0d-9536-78156484e3a4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6382024-11-27T18:45:53.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c77d2ef9-2a44-4f0d-9536-78156484e3a4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6392024-11-27T18:45:53.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 683 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 44a6fa12-a143-442d-affa-b5ea4fac097e response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
6402024-11-27T18:45:54.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c7419a12-8553-4fc9-b98c-dce182a690bd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6412024-11-27T18:45:54.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c7419a12-8553-4fc9-b98c-dce182a690bd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6422024-11-27T18:45:54.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c7419a12-8553-4fc9-b98c-dce182a690bd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6432024-11-27T18:45:55.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44028084-9874-43d0-ad47-6bd3f3be255e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6442024-11-27T18:45:55.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44028084-9874-43d0-ad47-6bd3f3be255e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6452024-11-27T18:45:55.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44028084-9874-43d0-ad47-6bd3f3be255e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6462024-11-27T18:45:56.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78742996-9a67-4d6a-b421-c503fa42ca4c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6472024-11-27T18:45:56.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78742996-9a67-4d6a-b421-c503fa42ca4c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6482024-11-27T18:45:56.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78742996-9a67-4d6a-b421-c503fa42ca4c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6492024-11-27T18:45:57.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 35d0807f-389e-4814-9af2-3ae750aacf41 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6502024-11-27T18:45:57.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 35d0807f-389e-4814-9af2-3ae750aacf41 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6512024-11-27T18:45:57.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 35d0807f-389e-4814-9af2-3ae750aacf41 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6522024-11-27T18:45:58.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 55676759-0ab3-4606-b3a1-a029cb550537 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6532024-11-27T18:45:58.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 55676759-0ab3-4606-b3a1-a029cb550537 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6542024-11-27T18:45:58.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 55676759-0ab3-4606-b3a1-a029cb550537 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6552024-11-27T18:45:59.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93dfe78a-880d-491b-a72c-e737786e513e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6562024-11-27T18:45:59.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93dfe78a-880d-491b-a72c-e737786e513e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6572024-11-27T18:45:59.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93dfe78a-880d-491b-a72c-e737786e513e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6582024-11-27T18:46:00.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 498e6516-0e5f-4ac7-8bd0-247490435f8b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6592024-11-27T18:46:00.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 498e6516-0e5f-4ac7-8bd0-247490435f8b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6602024-11-27T18:46:00.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 498e6516-0e5f-4ac7-8bd0-247490435f8b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6612024-11-27T18:46:01.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 079eff8b-2b04-4d48-b5d9-c9ddab0971bb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6622024-11-27T18:46:01.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 079eff8b-2b04-4d48-b5d9-c9ddab0971bb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6632024-11-27T18:46:01.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 079eff8b-2b04-4d48-b5d9-c9ddab0971bb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
6642024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
6652024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6662024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6672024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
6682024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
6692024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6702024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6712024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
6722024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6732024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
6742024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6752024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
6762024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
6772024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6782024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
6792024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6802024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
6812024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
6822024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6832024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
6842024-11-27T18:46:01.393ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6852024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6862024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6872024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
6882024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6892024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
6902024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
6912024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6922024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6932024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
6942024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
6952024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6962024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6972024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
6982024-11-27T18:46:01.393ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6992024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7002024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7012024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7022024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7032024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7042024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7052024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7062024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7072024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7082024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7092024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7102024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7112024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7122024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7132024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7142024-11-27T18:46:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7152024-11-27T18:46:01.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7162024-11-27T18:46:01.397ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.731545ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7172024-11-27T18:46:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7182024-11-27T18:46:01.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7192024-11-27T18:46:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7202024-11-27T18:46:01.398ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2795, tv_nsec: 394194482 } })
7212024-11-27T18:46:01.399ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
7222024-11-27T18:46:01.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7232024-11-27T18:46:01.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7242024-11-27T18:46:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7252024-11-27T18:46:01.403ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7262024-11-27T18:46:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7272024-11-27T18:46:01.403ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7282024-11-27T18:46:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7292024-11-27T18:46:01.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7302024-11-27T18:46:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7312024-11-27T18:46:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7322024-11-27T18:46:01.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7332024-11-27T18:46:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7342024-11-27T18:46:01.407ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7352024-11-27T18:46:01.409ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2795, tv_nsec: 405366467 } })
7362024-11-27T18:46:01.410ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
7372024-11-27T18:46:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7382024-11-27T18:46:01.410ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7392024-11-27T18:46:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7402024-11-27T18:46:01.412ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2795, tv_nsec: 407404178 } })
7412024-11-27T18:46:01.412ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
7422024-11-27T18:46:01.413ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7432024-11-27T18:46:01.413ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7442024-11-27T18:46:01.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7452024-11-27T18:46:01.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7462024-11-27T18:46:01.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7472024-11-27T18:46:01.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7482024-11-27T18:46:01.415ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7492024-11-27T18:46:01.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7502024-11-27T18:46:01.417ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7512024-11-27T18:46:01.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7522024-11-27T18:46:01.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 32.940348ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
7532024-11-27T18:46:01.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7542024-11-27T18:46:01.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7552024-11-27T18:46:01.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 40.694393ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7562024-11-27T18:46:01.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.932526ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
7572024-11-27T18:46:01.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7582024-11-27T18:46:01.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7592024-11-27T18:46:01.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7602024-11-27T18:46:01.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7612024-11-27T18:46:01.440ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7622024-11-27T18:46:01.440ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7632024-11-27T18:46:01.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7642024-11-27T18:46:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7652024-11-27T18:46:01.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7662024-11-27T18:46:01.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7672024-11-27T18:46:01.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7682024-11-27T18:46:01.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7692024-11-27T18:46:01.448ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7702024-11-27T18:46:01.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7712024-11-27T18:46:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7722024-11-27T18:46:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
7732024-11-27T18:46:01.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7742024-11-27T18:46:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7752024-11-27T18:46:01.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7762024-11-27T18:46:01.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7772024-11-27T18:46:01.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.37871ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7782024-11-27T18:46:01.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7792024-11-27T18:46:01.460ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 66.79373ms iteration = 24 status = 0
7802024-11-27T18:46:01.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
7812024-11-27T18:46:01.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7822024-11-27T18:46:01.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7832024-11-27T18:46:01.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7842024-11-27T18:46:01.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7852024-11-27T18:46:01.471ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7862024-11-27T18:46:01.471ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7872024-11-27T18:46:01.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.380122ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7882024-11-27T18:46:01.472ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfbdc7c8-269e-4b50-9a42-5876ddab5f88", "content-length": "26", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
7892024-11-27T18:46:01.472ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7902024-11-27T18:46:01.474ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7912024-11-27T18:46:01.474ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.241339ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7922024-11-27T18:46:01.474ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7932024-11-27T18:46:01.483ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
7942024-11-27T18:46:01.483ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.052344ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
7952024-11-27T18:46:01.484ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7962024-11-27T18:46:01.484ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7972024-11-27T18:46:01.484ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7982024-11-27T18:46:01.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7992024-11-27T18:46:01.485ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8002024-11-27T18:46:01.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8012024-11-27T18:46:01.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8022024-11-27T18:46:01.488ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8032024-11-27T18:46:01.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8042024-11-27T18:46:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8052024-11-27T18:46:01.491ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
8062024-11-27T18:46:01.491ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8072024-11-27T18:46:01.491ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea1faf43-d203-4258-9a62-fb25f9208e27", "content-length": "26", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8082024-11-27T18:46:01.491ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8092024-11-27T18:46:01.491ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
8102024-11-27T18:46:01.491ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8112024-11-27T18:46:01.492ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c153b482-6aac-4965-ba22-0e55cb1d369c", "content-length": "26", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8122024-11-27T18:46:01.492ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8132024-11-27T18:46:01.493ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
8142024-11-27T18:46:01.493ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8152024-11-27T18:46:01.513ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8162024-11-27T18:46:01.513ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8172024-11-27T18:46:01.513ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.127421ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8182024-11-27T18:46:01.514ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8192024-11-27T18:46:01.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8202024-11-27T18:46:01.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.813985ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
8212024-11-27T18:46:01.531ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.367666ms iteration = 27 status = {"physical_disks_added":0}
8222024-11-27T18:46:01.566ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 172.7186ms iteration = 24 status = {}
8232024-11-27T18:46:01.591ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8242024-11-27T18:46:01.592ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "af099187-843b-4b26-90e0-3d59f4ba8cbb", "content-length": "1", "date": "Wed, 27 Nov 2024 18:46:00 GMT"} })
8252024-11-27T18:46:01.593ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8262024-11-27T18:46:01.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8272024-11-27T18:46:01.596ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.574693ms iteration = 24 status = null
8282024-11-27T18:46:01.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8292024-11-27T18:46:01.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8302024-11-27T18:46:01.632ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8312024-11-27T18:46:01.632ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8322024-11-27T18:46:01.633ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad9b8613-cca2-47be-bdff-d361641413b4", "content-length": "372", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8332024-11-27T18:46:01.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8342024-11-27T18:46:01.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8352024-11-27T18:46:01.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8362024-11-27T18:46:01.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8372024-11-27T18:46:01.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8382024-11-27T18:46:01.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8392024-11-27T18:46:01.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8402024-11-27T18:46:01.645ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8412024-11-27T18:46:01.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8422024-11-27T18:46:01.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8432024-11-27T18:46:01.647ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8442024-11-27T18:46:01.647ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8452024-11-27T18:46:01.648ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5665a779-dd0b-437b-9dfa-d37ee917672d", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8462024-11-27T18:46:01.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8472024-11-27T18:46:01.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8482024-11-27T18:46:01.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8492024-11-27T18:46:01.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8502024-11-27T18:46:01.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8512024-11-27T18:46:01.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8522024-11-27T18:46:01.657ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8532024-11-27T18:46:01.657ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8542024-11-27T18:46:01.658ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62cb91d9-66a2-4b26-ab96-8b173af71e4b", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8552024-11-27T18:46:01.660ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 266.47884ms iteration = 24 status = {}
8562024-11-27T18:46:01.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8572024-11-27T18:46:01.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8582024-11-27T18:46:01.709ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
8592024-11-27T18:46:01.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8602024-11-27T18:46:01.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8612024-11-27T18:46:01.710ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8622024-11-27T18:46:01.710ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb49aad7-2872-46bc-95ba-20d73961eb39", "content-length": "691", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8632024-11-27T18:46:01.710ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8642024-11-27T18:46:01.710ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8652024-11-27T18:46:01.710ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8662024-11-27T18:46:01.712ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 318.482781ms iteration = 24 status = {}
8672024-11-27T18:46:01.719ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8682024-11-27T18:46:01.719ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fef7b6f-1caa-4d83-b96c-facfa7ef2aef", "content-length": "134", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8692024-11-27T18:46:01.719ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8702024-11-27T18:46:01.719ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
8712024-11-27T18:46:01.719ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8722024-11-27T18:46:01.719ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8732024-11-27T18:46:01.719ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8742024-11-27T18:46:01.719ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8752024-11-27T18:46:01.719ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8762024-11-27T18:46:01.719ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8772024-11-27T18:46:01.719ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8782024-11-27T18:46:01.719ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8792024-11-27T18:46:01.720ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
8802024-11-27T18:46:01.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8812024-11-27T18:46:01.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8822024-11-27T18:46:01.722ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8832024-11-27T18:46:01.722ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2f45597-22b4-46f1-ab7c-90c5504f5e12", "content-length": "2", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8842024-11-27T18:46:01.722ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8852024-11-27T18:46:01.722ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7bbf28e-5c8f-4fdd-9917-a5509224f31e", "content-length": "52", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8862024-11-27T18:46:01.722ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
8872024-11-27T18:46:01.722ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8882024-11-27T18:46:01.816ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "543c3404-3032-4cc9-ae4f-2c136d8e5d8c", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8892024-11-27T18:46:01.816ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
8902024-11-27T18:46:01.816ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8912024-11-27T18:46:01.816ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f04dc2f7-a2f1-40b1-8525-b27c51fb031c", "content-length": "682", "date": "Wed, 27 Nov 2024 18:46:01 GMT"} })
8922024-11-27T18:46:01.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8932024-11-27T18:46:01.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8942024-11-27T18:46:01.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8952024-11-27T18:46:01.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8962024-11-27T18:46:01.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8972024-11-27T18:46:01.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8982024-11-27T18:46:01.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8992024-11-27T18:46:01.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9002024-11-27T18:46:01.842ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 448.397975ms iteration = 24 status = {}
9012024-11-27T18:46:01.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 88deb7f9-599d-4d72-8e2b-93e5d407f208 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
9022024-11-27T18:46:01.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 88deb7f9-599d-4d72-8e2b-93e5d407f208 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
9032024-11-27T18:46:01.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 88deb7f9-599d-4d72-8e2b-93e5d407f208 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
9042024-11-27T18:46:02.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 26694504-6fa6-4028-b62f-e54bb8e6a8e0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9052024-11-27T18:46:02.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 26694504-6fa6-4028-b62f-e54bb8e6a8e0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9062024-11-27T18:46:02.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 26694504-6fa6-4028-b62f-e54bb8e6a8e0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9072024-11-27T18:46:03.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 16c7d67f-a264-4c95-9a03-e6f29ee300c6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9082024-11-27T18:46:03.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 16c7d67f-a264-4c95-9a03-e6f29ee300c6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9092024-11-27T18:46:03.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 16c7d67f-a264-4c95-9a03-e6f29ee300c6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9102024-11-27T18:46:03.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 571 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = cc266661-6e83-49c1-97e1-75f27c5539b8 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
9112024-11-27T18:46:04.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 736f12e9-5c89-4c1a-a423-9debdeb0dd28 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9122024-11-27T18:46:04.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 736f12e9-5c89-4c1a-a423-9debdeb0dd28 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9132024-11-27T18:46:04.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 736f12e9-5c89-4c1a-a423-9debdeb0dd28 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9142024-11-27T18:46:05.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d23f12ee-b2ae-4d95-ac17-2ace00089e01 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9152024-11-27T18:46:05.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d23f12ee-b2ae-4d95-ac17-2ace00089e01 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9162024-11-27T18:46:05.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d23f12ee-b2ae-4d95-ac17-2ace00089e01 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9172024-11-27T18:46:06.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bd3cfda3-2f16-403e-bb06-302141bf2447 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9182024-11-27T18:46:06.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bd3cfda3-2f16-403e-bb06-302141bf2447 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9192024-11-27T18:46:06.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bd3cfda3-2f16-403e-bb06-302141bf2447 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9202024-11-27T18:46:07.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ef159e65-d777-4493-ad0b-690a0eb4c5d8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9212024-11-27T18:46:07.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ef159e65-d777-4493-ad0b-690a0eb4c5d8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9222024-11-27T18:46:07.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ef159e65-d777-4493-ad0b-690a0eb4c5d8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9232024-11-27T18:46:08.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c6d2e70e-2484-4986-be85-308d93826faf roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9242024-11-27T18:46:08.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c6d2e70e-2484-4986-be85-308d93826faf resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9252024-11-27T18:46:08.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c6d2e70e-2484-4986-be85-308d93826faf response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9262024-11-27T18:46:09.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 75493f8f-ce8c-4caa-9968-777acaa11e41 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9272024-11-27T18:46:09.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 75493f8f-ce8c-4caa-9968-777acaa11e41 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9282024-11-27T18:46:09.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 75493f8f-ce8c-4caa-9968-777acaa11e41 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9292024-11-27T18:46:10.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 91e6d80a-b4df-467c-a612-449c84e56460 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9302024-11-27T18:46:10.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 91e6d80a-b4df-467c-a612-449c84e56460 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9312024-11-27T18:46:10.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 91e6d80a-b4df-467c-a612-449c84e56460 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9322024-11-27T18:46:11.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
9332024-11-27T18:46:11.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9342024-11-27T18:46:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9352024-11-27T18:46:11.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
9362024-11-27T18:46:11.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9372024-11-27T18:46:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9382024-11-27T18:46:11.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9392024-11-27T18:46:11.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9402024-11-27T18:46:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9412024-11-27T18:46:11.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.206558ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9422024-11-27T18:46:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9432024-11-27T18:46:11.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9442024-11-27T18:46:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9452024-11-27T18:46:11.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9462024-11-27T18:46:11.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9472024-11-27T18:46:11.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9482024-11-27T18:46:11.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
9492024-11-27T18:46:11.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9502024-11-27T18:46:11.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9512024-11-27T18:46:11.443ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
9522024-11-27T18:46:11.443ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.877359ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
9532024-11-27T18:46:11.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f0d7d648-1748-4097-8141-0549e07bed9e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9542024-11-27T18:46:11.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f0d7d648-1748-4097-8141-0549e07bed9e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9552024-11-27T18:46:11.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f0d7d648-1748-4097-8141-0549e07bed9e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9562024-11-27T18:46:12.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5602eb35-1218-4c6f-9bc0-324e7a1b67c4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9572024-11-27T18:46:12.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5602eb35-1218-4c6f-9bc0-324e7a1b67c4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9582024-11-27T18:46:12.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5602eb35-1218-4c6f-9bc0-324e7a1b67c4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9592024-11-27T18:46:13.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9bd39919-95d1-48c6-93eb-1090f2afac39 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9602024-11-27T18:46:13.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9bd39919-95d1-48c6-93eb-1090f2afac39 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9612024-11-27T18:46:13.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9bd39919-95d1-48c6-93eb-1090f2afac39 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9622024-11-27T18:46:13.585ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 618 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = ed911566-e116-43cd-b604-265d1142cd02 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
9632024-11-27T18:46:14.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f349bc0d-0f2a-472a-8e9c-5fda96970877 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9642024-11-27T18:46:14.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f349bc0d-0f2a-472a-8e9c-5fda96970877 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9652024-11-27T18:46:14.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f349bc0d-0f2a-472a-8e9c-5fda96970877 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9662024-11-27T18:46:15.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c245f29-66f4-441e-a145-f9cb9540713c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9672024-11-27T18:46:15.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c245f29-66f4-441e-a145-f9cb9540713c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9682024-11-27T18:46:15.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c245f29-66f4-441e-a145-f9cb9540713c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9692024-11-27T18:46:16.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fd430965-b557-4beb-9dc1-49ec5ac94225 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9702024-11-27T18:46:16.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fd430965-b557-4beb-9dc1-49ec5ac94225 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9712024-11-27T18:46:16.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fd430965-b557-4beb-9dc1-49ec5ac94225 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9722024-11-27T18:46:17.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e4442f0-0487-4f07-bc8f-45f1e65e76e1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9732024-11-27T18:46:17.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e4442f0-0487-4f07-bc8f-45f1e65e76e1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9742024-11-27T18:46:17.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e4442f0-0487-4f07-bc8f-45f1e65e76e1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9752024-11-27T18:46:18.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e6359ddd-9271-437e-ab6d-8b39d82416ec roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9762024-11-27T18:46:18.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e6359ddd-9271-437e-ab6d-8b39d82416ec resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9772024-11-27T18:46:18.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e6359ddd-9271-437e-ab6d-8b39d82416ec response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9782024-11-27T18:46:19.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5b7c74c-9fa2-4f1f-95f2-e3bbf94afe72 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9792024-11-27T18:46:19.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5b7c74c-9fa2-4f1f-95f2-e3bbf94afe72 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9802024-11-27T18:46:19.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5b7c74c-9fa2-4f1f-95f2-e3bbf94afe72 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9812024-11-27T18:46:20.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3ecb16d7-1e66-49cf-81f4-b49e8829baba roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9822024-11-27T18:46:20.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3ecb16d7-1e66-49cf-81f4-b49e8829baba resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9832024-11-27T18:46:20.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3ecb16d7-1e66-49cf-81f4-b49e8829baba response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9842024-11-27T18:46:21.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
9852024-11-27T18:46:21.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9862024-11-27T18:46:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9872024-11-27T18:46:21.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
9882024-11-27T18:46:21.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9892024-11-27T18:46:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9902024-11-27T18:46:21.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9912024-11-27T18:46:21.396ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9922024-11-27T18:46:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9932024-11-27T18:46:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9942024-11-27T18:46:21.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9952024-11-27T18:46:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9962024-11-27T18:46:21.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9972024-11-27T18:46:21.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9982024-11-27T18:46:21.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9992024-11-27T18:46:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
10002024-11-27T18:46:21.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10012024-11-27T18:46:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10022024-11-27T18:46:21.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
10032024-11-27T18:46:21.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.55263ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
10042024-11-27T18:46:21.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.525592ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10052024-11-27T18:46:21.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3560d1c4-daa4-4241-a6b5-1cf722b2d84c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10062024-11-27T18:46:21.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3560d1c4-daa4-4241-a6b5-1cf722b2d84c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10072024-11-27T18:46:21.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3560d1c4-daa4-4241-a6b5-1cf722b2d84c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10082024-11-27T18:46:22.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d127fe4c-bf54-48f4-b255-d188f34cbbb5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10092024-11-27T18:46:22.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d127fe4c-bf54-48f4-b255-d188f34cbbb5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10102024-11-27T18:46:22.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d127fe4c-bf54-48f4-b255-d188f34cbbb5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10112024-11-27T18:46:23.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 609 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 3ce4d8b0-3c54-44b8-a442-1971ae6f4cd2 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
10122024-11-27T18:46:23.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f54d38db-3250-4f7d-a6d2-ae9dd91b51b8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10132024-11-27T18:46:23.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f54d38db-3250-4f7d-a6d2-ae9dd91b51b8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10142024-11-27T18:46:23.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f54d38db-3250-4f7d-a6d2-ae9dd91b51b8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10152024-11-27T18:46:24.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abc4c610-d78e-489a-9133-dd98c5c3d7d4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10162024-11-27T18:46:24.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abc4c610-d78e-489a-9133-dd98c5c3d7d4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10172024-11-27T18:46:24.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abc4c610-d78e-489a-9133-dd98c5c3d7d4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10182024-11-27T18:46:25.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ca26a214-e9a2-4b3d-8d48-f3b2b2c49053 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10192024-11-27T18:46:25.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ca26a214-e9a2-4b3d-8d48-f3b2b2c49053 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10202024-11-27T18:46:25.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ca26a214-e9a2-4b3d-8d48-f3b2b2c49053 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10212024-11-27T18:46:26.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d5b4a1d-d36c-4554-bfb8-9105c6cc8595 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10222024-11-27T18:46:26.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d5b4a1d-d36c-4554-bfb8-9105c6cc8595 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10232024-11-27T18:46:26.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d5b4a1d-d36c-4554-bfb8-9105c6cc8595 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10242024-11-27T18:46:27.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fe69265c-472c-4e9c-b5e2-b38bd4acbbd0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10252024-11-27T18:46:27.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fe69265c-472c-4e9c-b5e2-b38bd4acbbd0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10262024-11-27T18:46:27.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fe69265c-472c-4e9c-b5e2-b38bd4acbbd0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10272024-11-27T18:46:28.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95700fbe-c851-4b34-8b28-e3e83e09ef57 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10282024-11-27T18:46:28.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95700fbe-c851-4b34-8b28-e3e83e09ef57 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10292024-11-27T18:46:28.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95700fbe-c851-4b34-8b28-e3e83e09ef57 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10302024-11-27T18:46:29.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3532e449-376d-49f7-881e-08224abd0831 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10312024-11-27T18:46:29.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3532e449-376d-49f7-881e-08224abd0831 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10322024-11-27T18:46:29.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3532e449-376d-49f7-881e-08224abd0831 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10332024-11-27T18:46:30.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3cf293c8-3920-46ab-9422-787350856160 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10342024-11-27T18:46:30.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3cf293c8-3920-46ab-9422-787350856160 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10352024-11-27T18:46:30.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3cf293c8-3920-46ab-9422-787350856160 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10362024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
10372024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10382024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
10392024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10402024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
10412024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
10422024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
10432024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10442024-11-27T18:46:31.393ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
10452024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10462024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.38\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
10472024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
10482024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10492024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
10502024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10512024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
10522024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
10532024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10542024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10552024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
10562024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
10572024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
10582024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10592024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10602024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
10612024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10622024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10632024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
10642024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10652024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
10662024-11-27T18:46:31.393ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10672024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
10682024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10692024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
10702024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10712024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
10722024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
10732024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10742024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
10752024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
10762024-11-27T18:46:31.393ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10772024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10782024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10792024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
10802024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10812024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10822024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
10832024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
10842024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10852024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10862024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
10872024-11-27T18:46:31.393ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:36:31.393431833 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10882024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10892024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
10902024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10912024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10922024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10932024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10942024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10952024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10962024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10972024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10982024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10992024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11002024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11012024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11022024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11032024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11042024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11052024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11062024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11072024-11-27T18:46:31.393ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2825, tv_nsec: 389153527 } })
11082024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11092024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11102024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
11112024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11122024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11132024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11142024-11-27T18:46:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11152024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11162024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
11172024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
11182024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11192024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
11202024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
11212024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11222024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
11232024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
11242024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11252024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11262024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11272024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
11282024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11292024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11302024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
11312024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11322024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.148897ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
11332024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11342024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11352024-11-27T18:46:31.394ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2825, tv_nsec: 389724026 } })
11362024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11372024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
11382024-11-27T18:46:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 852.692\u{b5}s iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
11392024-11-27T18:46:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.901413ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
11402024-11-27T18:46:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.781096ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11412024-11-27T18:46:31.397ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11422024-11-27T18:46:31.397ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11432024-11-27T18:46:31.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11442024-11-27T18:46:31.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11452024-11-27T18:46:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11462024-11-27T18:46:31.399ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11472024-11-27T18:46:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11482024-11-27T18:46:31.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11492024-11-27T18:46:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11502024-11-27T18:46:31.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11512024-11-27T18:46:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11522024-11-27T18:46:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11532024-11-27T18:46:31.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11542024-11-27T18:46:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11552024-11-27T18:46:31.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2825, tv_nsec: 401135965 } })
11562024-11-27T18:46:31.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
11572024-11-27T18:46:31.406ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:36:31.393431833 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11582024-11-27T18:46:31.406ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.373658ms iteration = 13 status = {"expiration":"2024-11-27T18:36:31.393431833Z","pruned":[]}
11592024-11-27T18:46:31.408ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.725098ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
11602024-11-27T18:46:31.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11612024-11-27T18:46:31.408ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11622024-11-27T18:46:31.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11632024-11-27T18:46:31.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11642024-11-27T18:46:31.409ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652024-11-27T18:46:31.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11662024-11-27T18:46:31.410ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11672024-11-27T18:46:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11682024-11-27T18:46:31.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11692024-11-27T18:46:31.413ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11702024-11-27T18:46:31.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11712024-11-27T18:46:31.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722024-11-27T18:46:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11732024-11-27T18:46:31.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11742024-11-27T18:46:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11752024-11-27T18:46:31.416ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2825, tv_nsec: 411812973 } })
11762024-11-27T18:46:31.416ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
11772024-11-27T18:46:31.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11782024-11-27T18:46:31.417ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11792024-11-27T18:46:31.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11802024-11-27T18:46:31.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11812024-11-27T18:46:31.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11822024-11-27T18:46:31.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11832024-11-27T18:46:31.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11842024-11-27T18:46:31.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11852024-11-27T18:46:31.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11862024-11-27T18:46:31.432ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11872024-11-27T18:46:31.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11882024-11-27T18:46:31.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11892024-11-27T18:46:31.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11902024-11-27T18:46:31.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11912024-11-27T18:46:31.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11922024-11-27T18:46:31.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11932024-11-27T18:46:31.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11942024-11-27T18:46:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11952024-11-27T18:46:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11962024-11-27T18:46:31.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11972024-11-27T18:46:31.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11982024-11-27T18:46:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11992024-11-27T18:46:31.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12002024-11-27T18:46:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12012024-11-27T18:46:31.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12022024-11-27T18:46:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12032024-11-27T18:46:31.443ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12042024-11-27T18:46:31.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
12052024-11-27T18:46:31.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12062024-11-27T18:46:31.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12072024-11-27T18:46:31.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12082024-11-27T18:46:31.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12092024-11-27T18:46:31.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12102024-11-27T18:46:31.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12112024-11-27T18:46:31.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12122024-11-27T18:46:31.447ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132024-11-27T18:46:31.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12142024-11-27T18:46:31.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12152024-11-27T18:46:31.447ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12162024-11-27T18:46:31.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.946615ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
12172024-11-27T18:46:31.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12182024-11-27T18:46:31.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2825, tv_nsec: 443602524 } })
12192024-11-27T18:46:31.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
12202024-11-27T18:46:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12212024-11-27T18:46:31.449ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12222024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12232024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12242024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12252024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12262024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12272024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12282024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12292024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12302024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12312024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12322024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12332024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12342024-11-27T18:46:31.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12352024-11-27T18:46:31.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12362024-11-27T18:46:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12372024-11-27T18:46:31.452ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 58.744131ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
12382024-11-27T18:46:31.452ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12392024-11-27T18:46:31.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12402024-11-27T18:46:31.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12412024-11-27T18:46:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12422024-11-27T18:46:31.452ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12432024-11-27T18:46:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12442024-11-27T18:46:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12452024-11-27T18:46:31.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12462024-11-27T18:46:31.453ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12472024-11-27T18:46:31.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
12482024-11-27T18:46:31.453ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12492024-11-27T18:46:31.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12502024-11-27T18:46:31.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12512024-11-27T18:46:31.455ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12522024-11-27T18:46:31.455ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12532024-11-27T18:46:31.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12542024-11-27T18:46:31.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12552024-11-27T18:46:31.456ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12562024-11-27T18:46:31.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12572024-11-27T18:46:31.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12582024-11-27T18:46:31.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12592024-11-27T18:46:31.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12602024-11-27T18:46:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12612024-11-27T18:46:31.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12622024-11-27T18:46:31.460ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
12632024-11-27T18:46:31.460ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
12642024-11-27T18:46:31.460ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.055909ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
12652024-11-27T18:46:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12662024-11-27T18:46:31.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12672024-11-27T18:46:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12682024-11-27T18:46:31.461ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12692024-11-27T18:46:31.461ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12702024-11-27T18:46:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12712024-11-27T18:46:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12722024-11-27T18:46:31.462ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 69.574891ms iteration = 6 status = {"nsuccess":5}
12732024-11-27T18:46:31.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12742024-11-27T18:46:31.466ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
12752024-11-27T18:46:31.466ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.215385ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
12762024-11-27T18:46:31.467ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12772024-11-27T18:46:31.467ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12782024-11-27T18:46:31.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12792024-11-27T18:46:31.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12802024-11-27T18:46:31.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12812024-11-27T18:46:31.474ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12822024-11-27T18:46:31.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12832024-11-27T18:46:31.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12842024-11-27T18:46:31.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12852024-11-27T18:46:31.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12862024-11-27T18:46:31.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
12872024-11-27T18:46:31.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12882024-11-27T18:46:31.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12892024-11-27T18:46:31.492ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.805074ms iteration = 25 status = 0
12902024-11-27T18:46:31.493ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12912024-11-27T18:46:31.493ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.722778ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12922024-11-27T18:46:31.498ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12932024-11-27T18:46:31.498ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12942024-11-27T18:46:31.498ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12952024-11-27T18:46:31.498ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12962024-11-27T18:46:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12972024-11-27T18:46:31.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12982024-11-27T18:46:31.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.302256ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12992024-11-27T18:46:31.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13002024-11-27T18:46:31.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13012024-11-27T18:46:31.503ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13022024-11-27T18:46:31.503ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13032024-11-27T18:46:31.503ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13042024-11-27T18:46:31.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13052024-11-27T18:46:31.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13062024-11-27T18:46:31.505ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 112.03376ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13072024-11-27T18:46:31.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 114.69534ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13082024-11-27T18:46:31.510ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
13092024-11-27T18:46:31.510ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
13102024-11-27T18:46:31.510ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.179047ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
13112024-11-27T18:46:31.511ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13122024-11-27T18:46:31.511ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13132024-11-27T18:46:31.511ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13142024-11-27T18:46:31.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13152024-11-27T18:46:31.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13162024-11-27T18:46:31.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13172024-11-27T18:46:31.513ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13182024-11-27T18:46:31.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13192024-11-27T18:46:31.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13202024-11-27T18:46:31.515ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
13212024-11-27T18:46:31.515ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 122.11554ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13222024-11-27T18:46:31.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13232024-11-27T18:46:31.516ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
13242024-11-27T18:46:31.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13252024-11-27T18:46:31.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13262024-11-27T18:46:31.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13272024-11-27T18:46:31.520ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13282024-11-27T18:46:31.520ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13292024-11-27T18:46:31.520ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
13302024-11-27T18:46:31.520ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 126.951792ms iteration = 13 status = {"generation":1}
13312024-11-27T18:46:31.535ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13322024-11-27T18:46:31.535ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13332024-11-27T18:46:31.535ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.569294ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
13342024-11-27T18:46:31.539ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13352024-11-27T18:46:31.539ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
13362024-11-27T18:46:31.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13372024-11-27T18:46:31.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13382024-11-27T18:46:31.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13392024-11-27T18:46:31.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13402024-11-27T18:46:31.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13412024-11-27T18:46:31.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13422024-11-27T18:46:31.550ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.22533ms iteration = 28 status = {"physical_disks_added":0}
13432024-11-27T18:46:31.553ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
13442024-11-27T18:46:31.553ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13452024-11-27T18:46:31.553ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e65953cb-a9bb-408e-92a1-32b946e6b2fe", "content-length": "26", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
13462024-11-27T18:46:31.553ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13472024-11-27T18:46:31.556ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13482024-11-27T18:46:31.556ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
13492024-11-27T18:46:31.556ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13502024-11-27T18:46:31.556ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b85540e-f595-4e42-8018-7c8efdec8d30", "content-length": "26", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
13512024-11-27T18:46:31.556ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13522024-11-27T18:46:31.558ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13532024-11-27T18:46:31.575ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
13542024-11-27T18:46:31.575ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 182.236981ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
13552024-11-27T18:46:31.699ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13562024-11-27T18:46:31.711ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13572024-11-27T18:46:31.711ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13582024-11-27T18:46:31.712ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ab23758-d3b9-4a70-856d-255971f5a9e9", "content-length": "372", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
13592024-11-27T18:46:31.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13602024-11-27T18:46:31.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13612024-11-27T18:46:31.715ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
13622024-11-27T18:46:31.715ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13632024-11-27T18:46:31.715ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
13642024-11-27T18:46:31.715ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 322.209656ms iteration = 13 status = {"generation":2}
13652024-11-27T18:46:31.717ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
13662024-11-27T18:46:31.717ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e0aebcda-c29c-4d50-8c42-0412bf5baccf", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13672024-11-27T18:46:31.717ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13682024-11-27T18:46:31.719ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fdf1568b-b071-4e12-9bce-17de74927b34", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13692024-11-27T18:46:31.719ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13702024-11-27T18:46:31.720ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
13712024-11-27T18:46:31.720ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13722024-11-27T18:46:31.720ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13732024-11-27T18:46:31.720ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 327.271381ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13742024-11-27T18:46:31.720ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "467f87ab-8f97-462f-8985-07c1e41bf863", "content-length": "26", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
13752024-11-27T18:46:31.720ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13762024-11-27T18:46:31.722ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
13772024-11-27T18:46:31.757ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13782024-11-27T18:46:31.758ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "45f47275-3d25-4e9b-850b-2ce7e54c1fe1", "content-length": "691", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
13792024-11-27T18:46:31.758ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
13802024-11-27T18:46:31.758ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
13812024-11-27T18:46:31.758ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
13822024-11-27T18:46:31.760ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13832024-11-27T18:46:31.760ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 367.120431ms iteration = 25 status = {}
13842024-11-27T18:46:31.760ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "948a2aa3-c1cf-43f8-b2f5-393ed1a88a60", "content-length": "1", "date": "Wed, 27 Nov 2024 18:46:30 GMT"} })
13852024-11-27T18:46:31.762ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13862024-11-27T18:46:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13872024-11-27T18:46:31.764ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 370.173517ms iteration = 25 status = null
13882024-11-27T18:46:31.788ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 395.637993ms iteration = 25 status = {}
13892024-11-27T18:46:31.798ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13902024-11-27T18:46:31.798ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "31406081-27b3-4b6c-9475-05dbe06a8a86", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13912024-11-27T18:46:31.798ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13922024-11-27T18:46:31.800ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d1e7c09f-91f4-41c2-b845-b66254162915", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13932024-11-27T18:46:31.800ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13942024-11-27T18:46:31.802ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f4ef1847-cb9c-4dca-82a2-17b87728601c", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13952024-11-27T18:46:31.802ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13962024-11-27T18:46:31.804ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13972024-11-27T18:46:31.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 411.516969ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13982024-11-27T18:46:31.810ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
13992024-11-27T18:46:31.810ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14002024-11-27T18:46:31.810ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "08cc0c78-59c1-4c71-b569-5ad2ce9bb20a", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
14012024-11-27T18:46:31.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14022024-11-27T18:46:31.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14032024-11-27T18:46:31.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14042024-11-27T18:46:31.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14052024-11-27T18:46:31.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14062024-11-27T18:46:31.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14072024-11-27T18:46:31.820ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14082024-11-27T18:46:31.820ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14092024-11-27T18:46:31.820ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9140f9a0-f0d3-412f-82fd-0f2b528bd16e", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
14102024-11-27T18:46:31.822ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 429.264982ms iteration = 25 status = {}
14112024-11-27T18:46:31.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14122024-11-27T18:46:31.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14132024-11-27T18:46:31.872ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
14142024-11-27T18:46:31.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14152024-11-27T18:46:31.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14162024-11-27T18:46:31.881ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14172024-11-27T18:46:31.882ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2693c252-2960-4483-b8d6-c044f61c418a", "content-length": "134", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
14182024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
14192024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
14202024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14212024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14222024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14232024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14242024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14252024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14262024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14272024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14282024-11-27T18:46:31.882ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
14292024-11-27T18:46:31.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14302024-11-27T18:46:31.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14312024-11-27T18:46:31.885ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14322024-11-27T18:46:31.885ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "539c808f-9ab3-4862-ac98-f8fe25bc17b2", "content-length": "2", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
14332024-11-27T18:46:31.885ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14342024-11-27T18:46:31.885ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a582298-6266-4d38-bbd5-94c9f2e805ff", "content-length": "52", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
14352024-11-27T18:46:31.885ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
14362024-11-27T18:46:31.885ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14372024-11-27T18:46:31.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 628bbcd9-8ac7-4b39-9bb8-e04bddd8ee29 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
14382024-11-27T18:46:31.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 628bbcd9-8ac7-4b39-9bb8-e04bddd8ee29 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
14392024-11-27T18:46:31.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 628bbcd9-8ac7-4b39-9bb8-e04bddd8ee29 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
14402024-11-27T18:46:31.988ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6bf09db9-6bc2-490f-81ce-80caeff0b92d", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
14412024-11-27T18:46:31.988ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
14422024-11-27T18:46:31.988ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14432024-11-27T18:46:31.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = af1d0b72-97b3-48c2-bf42-b678f62200d0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14442024-11-27T18:46:31.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = af1d0b72-97b3-48c2-bf42-b678f62200d0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14452024-11-27T18:46:31.989ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8db53848-8ea7-4c51-a6c3-8ce614f400a1", "content-length": "682", "date": "Wed, 27 Nov 2024 18:46:31 GMT"} })
14462024-11-27T18:46:31.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14472024-11-27T18:46:31.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14482024-11-27T18:46:31.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = af1d0b72-97b3-48c2-bf42-b678f62200d0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14492024-11-27T18:46:32.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14502024-11-27T18:46:32.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14512024-11-27T18:46:32.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14522024-11-27T18:46:32.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14532024-11-27T18:46:32.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14542024-11-27T18:46:32.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14552024-11-27T18:46:32.017ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 624.611928ms iteration = 25 status = {}
14562024-11-27T18:46:33.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a9b79014-e973-49ce-9978-8709cdaf72da roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14572024-11-27T18:46:33.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a9b79014-e973-49ce-9978-8709cdaf72da resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14582024-11-27T18:46:33.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a9b79014-e973-49ce-9978-8709cdaf72da response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14592024-11-27T18:46:33.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 556 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 5c52d2b4-80f2-4aa4-a448-d96362aa4dd6 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
14602024-11-27T18:46:34.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a236975-9cbd-4322-987d-17e105917b02 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14612024-11-27T18:46:34.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a236975-9cbd-4322-987d-17e105917b02 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14622024-11-27T18:46:34.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a236975-9cbd-4322-987d-17e105917b02 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14632024-11-27T18:46:35.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4a70d6cc-0824-451b-9d40-0defdfd0fd72 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14642024-11-27T18:46:35.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4a70d6cc-0824-451b-9d40-0defdfd0fd72 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14652024-11-27T18:46:35.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4a70d6cc-0824-451b-9d40-0defdfd0fd72 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14662024-11-27T18:46:36.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b0030da-1402-4ebf-9bf9-dfc21fc23aee roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14672024-11-27T18:46:36.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b0030da-1402-4ebf-9bf9-dfc21fc23aee resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14682024-11-27T18:46:36.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b0030da-1402-4ebf-9bf9-dfc21fc23aee response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14692024-11-27T18:46:37.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be285d2a-fbc1-4c17-9440-7faa8b887b68 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14702024-11-27T18:46:37.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be285d2a-fbc1-4c17-9440-7faa8b887b68 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14712024-11-27T18:46:37.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be285d2a-fbc1-4c17-9440-7faa8b887b68 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14722024-11-27T18:46:38.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0957bc13-9be2-4945-9419-5f63558aa05f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14732024-11-27T18:46:38.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0957bc13-9be2-4945-9419-5f63558aa05f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14742024-11-27T18:46:38.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0957bc13-9be2-4945-9419-5f63558aa05f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14752024-11-27T18:46:39.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 493c8cb2-3597-4bac-ad4f-59e4ca469ee6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14762024-11-27T18:46:39.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 493c8cb2-3597-4bac-ad4f-59e4ca469ee6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14772024-11-27T18:46:39.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 493c8cb2-3597-4bac-ad4f-59e4ca469ee6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14782024-11-27T18:46:40.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8993b295-1545-474a-8aab-8b373b4c6942 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14792024-11-27T18:46:40.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8993b295-1545-474a-8aab-8b373b4c6942 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14802024-11-27T18:46:40.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8993b295-1545-474a-8aab-8b373b4c6942 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14812024-11-27T18:46:41.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8bfb8b21-b113-4f69-bc4d-e4c331831e14 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14822024-11-27T18:46:41.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8bfb8b21-b113-4f69-bc4d-e4c331831e14 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14832024-11-27T18:46:41.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8bfb8b21-b113-4f69-bc4d-e4c331831e14 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
14842024-11-27T18:46:41.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
14852024-11-27T18:46:41.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14862024-11-27T18:46:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14872024-11-27T18:46:41.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
14882024-11-27T18:46:41.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14892024-11-27T18:46:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14902024-11-27T18:46:41.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14912024-11-27T18:46:41.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14922024-11-27T18:46:41.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14932024-11-27T18:46:41.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.182367ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14942024-11-27T18:46:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14952024-11-27T18:46:41.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14962024-11-27T18:46:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14972024-11-27T18:46:41.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14982024-11-27T18:46:41.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14992024-11-27T18:46:41.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15002024-11-27T18:46:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
15012024-11-27T18:46:41.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15022024-11-27T18:46:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15032024-11-27T18:46:41.414ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
15042024-11-27T18:46:41.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.047872ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
15052024-11-27T18:46:42.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fe8daf81-9033-40bb-ac79-dd170725834d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15062024-11-27T18:46:42.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fe8daf81-9033-40bb-ac79-dd170725834d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15072024-11-27T18:46:42.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fe8daf81-9033-40bb-ac79-dd170725834d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15082024-11-27T18:46:43.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9f823f80-9513-49cd-a116-b2f343c1d286 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15092024-11-27T18:46:43.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9f823f80-9513-49cd-a116-b2f343c1d286 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15102024-11-27T18:46:43.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9f823f80-9513-49cd-a116-b2f343c1d286 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15112024-11-27T18:46:43.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 645 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 38179880-0127-46c5-ae95-ee8f230cfe89 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
15122024-11-27T18:46:44.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6dd9621a-3cc7-4559-8151-7d748a1e897f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15132024-11-27T18:46:44.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6dd9621a-3cc7-4559-8151-7d748a1e897f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15142024-11-27T18:46:44.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6dd9621a-3cc7-4559-8151-7d748a1e897f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15152024-11-27T18:46:45.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dbd3abd3-1c04-487d-9203-34458640e0ff roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15162024-11-27T18:46:45.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dbd3abd3-1c04-487d-9203-34458640e0ff resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15172024-11-27T18:46:45.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dbd3abd3-1c04-487d-9203-34458640e0ff response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15182024-11-27T18:46:46.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c2ebce6-eda0-43f9-9e87-b8339e85a533 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15192024-11-27T18:46:46.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c2ebce6-eda0-43f9-9e87-b8339e85a533 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15202024-11-27T18:46:46.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c2ebce6-eda0-43f9-9e87-b8339e85a533 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15212024-11-27T18:46:47.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c149b0fe-dcc4-4235-91ac-4160ec2f9cc5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15222024-11-27T18:46:47.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c149b0fe-dcc4-4235-91ac-4160ec2f9cc5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15232024-11-27T18:46:47.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c149b0fe-dcc4-4235-91ac-4160ec2f9cc5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15242024-11-27T18:46:48.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb4be8bc-6ece-4576-8bc5-514466626737 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15252024-11-27T18:46:48.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb4be8bc-6ece-4576-8bc5-514466626737 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15262024-11-27T18:46:48.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb4be8bc-6ece-4576-8bc5-514466626737 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15272024-11-27T18:46:49.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3966cace-50cd-4414-828c-51bc2cfe44ad roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15282024-11-27T18:46:49.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3966cace-50cd-4414-828c-51bc2cfe44ad resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15292024-11-27T18:46:49.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3966cace-50cd-4414-828c-51bc2cfe44ad response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15302024-11-27T18:46:50.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 41686ee5-e7fe-4a26-884b-6c1323fda0be roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15312024-11-27T18:46:50.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 41686ee5-e7fe-4a26-884b-6c1323fda0be resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15322024-11-27T18:46:50.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 41686ee5-e7fe-4a26-884b-6c1323fda0be response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15332024-11-27T18:46:51.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
15342024-11-27T18:46:51.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15352024-11-27T18:46:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15362024-11-27T18:46:51.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
15372024-11-27T18:46:51.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15382024-11-27T18:46:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15392024-11-27T18:46:51.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15402024-11-27T18:46:51.396ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15412024-11-27T18:46:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15422024-11-27T18:46:51.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15432024-11-27T18:46:51.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15442024-11-27T18:46:51.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15452024-11-27T18:46:51.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.528727ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15462024-11-27T18:46:51.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15472024-11-27T18:46:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15482024-11-27T18:46:51.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15492024-11-27T18:46:51.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
15502024-11-27T18:46:51.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15512024-11-27T18:46:51.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15522024-11-27T18:46:51.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 36d4472d-b4ee-4305-8ca8-97227b0522e3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15532024-11-27T18:46:51.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 36d4472d-b4ee-4305-8ca8-97227b0522e3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15542024-11-27T18:46:51.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 36d4472d-b4ee-4305-8ca8-97227b0522e3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15552024-11-27T18:46:51.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
15562024-11-27T18:46:51.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.718423ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
15572024-11-27T18:46:52.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 29cc564d-73dd-4aa5-bb0d-a8d7bda09e6f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15582024-11-27T18:46:52.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 29cc564d-73dd-4aa5-bb0d-a8d7bda09e6f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15592024-11-27T18:46:52.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 29cc564d-73dd-4aa5-bb0d-a8d7bda09e6f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15602024-11-27T18:46:53.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78efd382-f4fc-4bc1-873c-4154092012ec roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15612024-11-27T18:46:53.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78efd382-f4fc-4bc1-873c-4154092012ec resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15622024-11-27T18:46:53.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78efd382-f4fc-4bc1-873c-4154092012ec response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15632024-11-27T18:46:53.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 603 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 424cc1a5-5805-4bea-b32e-7c09e2f08627 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
15642024-11-27T18:46:54.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb83b031-7e1a-455b-9661-042539873602 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15652024-11-27T18:46:54.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb83b031-7e1a-455b-9661-042539873602 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15662024-11-27T18:46:54.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb83b031-7e1a-455b-9661-042539873602 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15672024-11-27T18:46:54.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 344a926f-6563-4b58-9f3c-5077dbb343e0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
15682024-11-27T18:46:54.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 344a926f-6563-4b58-9f3c-5077dbb343e0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
15692024-11-27T18:46:54.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 344a926f-6563-4b58-9f3c-5077dbb343e0 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
15702024-11-27T18:46:54.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 1be41f9d-695a-4313-ba1c-de57e94a0760 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
15712024-11-27T18:46:54.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 1be41f9d-695a-4313-ba1c-de57e94a0760 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
15722024-11-27T18:46:54.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 1be41f9d-695a-4313-ba1c-de57e94a0760 response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
15732024-11-27T18:46:55.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = baee2524-8b5f-4e52-ad34-cf608417648e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15742024-11-27T18:46:55.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = baee2524-8b5f-4e52-ad34-cf608417648e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15752024-11-27T18:46:55.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = baee2524-8b5f-4e52-ad34-cf608417648e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15762024-11-27T18:46:56.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1135e834-7481-4535-84bd-469d942522de roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15772024-11-27T18:46:56.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1135e834-7481-4535-84bd-469d942522de resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15782024-11-27T18:46:56.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1135e834-7481-4535-84bd-469d942522de response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15792024-11-27T18:46:57.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1daf1cd1-3ead-4060-a8ff-c74a29e08ece roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15802024-11-27T18:46:57.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1daf1cd1-3ead-4060-a8ff-c74a29e08ece resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15812024-11-27T18:46:57.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1daf1cd1-3ead-4060-a8ff-c74a29e08ece response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15822024-11-27T18:46:58.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 077d68bf-b950-417e-89cd-dd2e87d5e27d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15832024-11-27T18:46:58.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 077d68bf-b950-417e-89cd-dd2e87d5e27d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15842024-11-27T18:46:58.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 077d68bf-b950-417e-89cd-dd2e87d5e27d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15852024-11-27T18:46:59.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2df709ae-9301-4779-83d3-fb1f9d0b0ecc roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15862024-11-27T18:46:59.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2df709ae-9301-4779-83d3-fb1f9d0b0ecc resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15872024-11-27T18:46:59.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2df709ae-9301-4779-83d3-fb1f9d0b0ecc response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15882024-11-27T18:47:00.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c4d06774-04ae-4501-b546-53302f31f505 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15892024-11-27T18:47:00.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c4d06774-04ae-4501-b546-53302f31f505 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15902024-11-27T18:47:00.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c4d06774-04ae-4501-b546-53302f31f505 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15912024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
15922024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15932024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
15942024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
15952024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15962024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15972024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
15982024-11-27T18:47:01.393ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15992024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16002024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
16012024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
16022024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16032024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16042024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16052024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
16062024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
16072024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16082024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16092024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
16102024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16112024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
16122024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16132024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
16142024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
16152024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16162024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
16172024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16182024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
16192024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16202024-11-27T18:47:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16212024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16222024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16232024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16242024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16252024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16262024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16272024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16282024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16292024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16302024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16312024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16322024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16332024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
16342024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
16352024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16362024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
16372024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16382024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16392024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16402024-11-27T18:47:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16412024-11-27T18:47:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16422024-11-27T18:47:01.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.931804ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
16432024-11-27T18:47:01.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16442024-11-27T18:47:01.397ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.422631ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16452024-11-27T18:47:01.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16462024-11-27T18:47:01.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.851297ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
16472024-11-27T18:47:01.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16482024-11-27T18:47:01.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16492024-11-27T18:47:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16502024-11-27T18:47:01.398ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2855, tv_nsec: 393992969 } })
16512024-11-27T18:47:01.399ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
16522024-11-27T18:47:01.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16532024-11-27T18:47:01.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16542024-11-27T18:47:01.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16552024-11-27T18:47:01.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16562024-11-27T18:47:01.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16572024-11-27T18:47:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16582024-11-27T18:47:01.402ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16592024-11-27T18:47:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16602024-11-27T18:47:01.403ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16612024-11-27T18:47:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16622024-11-27T18:47:01.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16632024-11-27T18:47:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16642024-11-27T18:47:01.406ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16652024-11-27T18:47:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16662024-11-27T18:47:01.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16672024-11-27T18:47:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16682024-11-27T18:47:01.406ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16692024-11-27T18:47:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16702024-11-27T18:47:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16712024-11-27T18:47:01.408ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2855, tv_nsec: 403260916 } })
16722024-11-27T18:47:01.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16732024-11-27T18:47:01.408ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16742024-11-27T18:47:01.408ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
16752024-11-27T18:47:01.409ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16762024-11-27T18:47:01.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16772024-11-27T18:47:01.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16782024-11-27T18:47:01.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16792024-11-27T18:47:01.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16802024-11-27T18:47:01.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16812024-11-27T18:47:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16822024-11-27T18:47:01.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16832024-11-27T18:47:01.411ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16842024-11-27T18:47:01.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16852024-11-27T18:47:01.412ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2855, tv_nsec: 407484059 } })
16862024-11-27T18:47:01.412ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
16872024-11-27T18:47:01.416ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16882024-11-27T18:47:01.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16892024-11-27T18:47:01.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16902024-11-27T18:47:01.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16912024-11-27T18:47:01.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
16922024-11-27T18:47:01.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16932024-11-27T18:47:01.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16942024-11-27T18:47:01.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16952024-11-27T18:47:01.421ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16962024-11-27T18:47:01.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16972024-11-27T18:47:01.430ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16982024-11-27T18:47:01.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16992024-11-27T18:47:01.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17002024-11-27T18:47:01.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17012024-11-27T18:47:01.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 39.945292ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
17022024-11-27T18:47:01.434ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17032024-11-27T18:47:01.434ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17042024-11-27T18:47:01.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17052024-11-27T18:47:01.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17062024-11-27T18:47:01.434ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
17072024-11-27T18:47:01.434ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.262871ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
17082024-11-27T18:47:01.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17092024-11-27T18:47:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17102024-11-27T18:47:01.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17112024-11-27T18:47:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17122024-11-27T18:47:01.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17132024-11-27T18:47:01.445ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17142024-11-27T18:47:01.445ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17152024-11-27T18:47:01.445ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e76501c7-91ce-400f-9399-cf0d7274b5fc", "content-length": "26", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
17162024-11-27T18:47:01.445ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17172024-11-27T18:47:01.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.415626ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
17182024-11-27T18:47:01.446ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17192024-11-27T18:47:01.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17202024-11-27T18:47:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
17212024-11-27T18:47:01.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17222024-11-27T18:47:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17232024-11-27T18:47:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17242024-11-27T18:47:01.450ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 57.175997ms iteration = 26 status = 0
17252024-11-27T18:47:01.455ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17262024-11-27T18:47:01.455ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17272024-11-27T18:47:01.455ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2a97adc-3f77-4ccd-a22b-1ced4c215d87", "content-length": "26", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
17282024-11-27T18:47:01.455ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17292024-11-27T18:47:01.456ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17302024-11-27T18:47:01.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17312024-11-27T18:47:01.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17322024-11-27T18:47:01.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.692649ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17332024-11-27T18:47:01.471ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
17342024-11-27T18:47:01.471ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17352024-11-27T18:47:01.471ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4aff6ca4-a08a-40d5-b12f-831a46ce3fcb", "content-length": "26", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
17362024-11-27T18:47:01.471ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17372024-11-27T18:47:01.473ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
17382024-11-27T18:47:01.475ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17392024-11-27T18:47:01.475ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17402024-11-27T18:47:01.475ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17412024-11-27T18:47:01.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17422024-11-27T18:47:01.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.058606ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17432024-11-27T18:47:01.532ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 138.250059ms iteration = 29 status = {"physical_disks_added":0}
17442024-11-27T18:47:01.545ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 151.898981ms iteration = 26 status = {}
17452024-11-27T18:47:01.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17462024-11-27T18:47:01.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17472024-11-27T18:47:01.559ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7/state
17482024-11-27T18:47:01.559ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17492024-11-27T18:47:01.559ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "37591805-faa2-4f55-9e8f-f79822b64944", "content-length": "1", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
17502024-11-27T18:47:01.560ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17512024-11-27T18:47:01.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17522024-11-27T18:47:01.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17532024-11-27T18:47:01.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17542024-11-27T18:47:01.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17552024-11-27T18:47:01.563ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 168.618019ms iteration = 26 status = null
17562024-11-27T18:47:01.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17572024-11-27T18:47:01.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17582024-11-27T18:47:01.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17592024-11-27T18:47:01.566ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17602024-11-27T18:47:01.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17612024-11-27T18:47:01.575ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17622024-11-27T18:47:01.575ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17632024-11-27T18:47:01.575ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "90bfd9f2-64dd-4f6a-8a75-0b3436ba968f", "content-length": "525", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
17642024-11-27T18:47:01.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17652024-11-27T18:47:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17662024-11-27T18:47:01.589ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17672024-11-27T18:47:01.589ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17682024-11-27T18:47:01.589ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 196.279ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17692024-11-27T18:47:01.631ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {f69caef5-cd3e-4773-91ca-a68c04f4a199: {10.151.2.175: {bfe35947-9ebe-4f69-997e-18fe90f93616}, 10.151.2.176: {bfe35947-9ebe-4f69-997e-18fe90f93616}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17702024-11-27T18:47:01.631ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17712024-11-27T18:47:01.632ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6a5d1697-fde9-4a41-85c6-2d2f37333174", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
17722024-11-27T18:47:01.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17732024-11-27T18:47:01.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17742024-11-27T18:47:01.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cf2d98c2-356c-4d87-b878-87e5256b8a81 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17752024-11-27T18:47:01.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cf2d98c2-356c-4d87-b878-87e5256b8a81 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17762024-11-27T18:47:01.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17772024-11-27T18:47:01.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17782024-11-27T18:47:01.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cf2d98c2-356c-4d87-b878-87e5256b8a81 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17792024-11-27T18:47:01.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17802024-11-27T18:47:01.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17812024-11-27T18:47:01.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17822024-11-27T18:47:01.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17832024-11-27T18:47:01.645ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
17842024-11-27T18:47:01.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17852024-11-27T18:47:01.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17862024-11-27T18:47:01.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17872024-11-27T18:47:01.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17882024-11-27T18:47:01.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17892024-11-27T18:47:01.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17902024-11-27T18:47:01.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17912024-11-27T18:47:01.664ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17922024-11-27T18:47:01.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17932024-11-27T18:47:01.664ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7638f407-273d-4cff-8168-72fc0658c9ae", "content-length": "134", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
17942024-11-27T18:47:01.664ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17952024-11-27T18:47:01.664ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
17962024-11-27T18:47:01.664ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17972024-11-27T18:47:01.664ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17982024-11-27T18:47:01.664ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17992024-11-27T18:47:01.664ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18002024-11-27T18:47:01.664ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18012024-11-27T18:47:01.664ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18022024-11-27T18:47:01.664ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18032024-11-27T18:47:01.664ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18042024-11-27T18:47:01.665ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
18052024-11-27T18:47:01.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18062024-11-27T18:47:01.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18072024-11-27T18:47:01.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18082024-11-27T18:47:01.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18092024-11-27T18:47:01.695ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18102024-11-27T18:47:01.695ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c42c5f0d-2ba6-4f92-a439-9eeb8d22be1b", "content-length": "811", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
18112024-11-27T18:47:01.695ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(14175096) }} sled = sock
18122024-11-27T18:47:01.695ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18132024-11-27T18:47:01.695ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18142024-11-27T18:47:01.697ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18152024-11-27T18:47:01.697ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 303.545329ms iteration = 26 status = {}
18162024-11-27T18:47:01.697ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "85454b1d-74dd-4745-87df-23ba39f8514e", "content-length": "2", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
18172024-11-27T18:47:01.697ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18182024-11-27T18:47:01.697ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "183c8964-f5b9-4498-889c-5cee9b4b3588", "content-length": "52", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
18192024-11-27T18:47:01.697ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
18202024-11-27T18:47:01.697ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18212024-11-27T18:47:01.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18222024-11-27T18:47:01.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18232024-11-27T18:47:01.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18242024-11-27T18:47:01.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18252024-11-27T18:47:01.702ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18262024-11-27T18:47:01.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18272024-11-27T18:47:01.704ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18282024-11-27T18:47:01.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18292024-11-27T18:47:01.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18302024-11-27T18:47:01.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18312024-11-27T18:47:01.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18322024-11-27T18:47:01.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18332024-11-27T18:47:01.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18342024-11-27T18:47:01.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 097aad34-aef6-49d4-a0a1-23f4efd53bf1, lookup_type: ById(097aad34-aef6-49d4-a0a1-23f4efd53bf1) }, key: 48ce581b-0a1c-4f72-b0e2-dbd5e0eb7518, lookup_type: ById(48ce581b-0a1c-4f72-b0e2-dbd5e0eb7518) }, key: 97a6e3ad-ebcf-4655-b068-a4bd116f2ef3, lookup_type: ById(97a6e3ad-ebcf-4655-b068-a4bd116f2ef3) } result = Ok(())
18352024-11-27T18:47:01.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18362024-11-27T18:47:01.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18372024-11-27T18:47:01.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18382024-11-27T18:47:01.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18392024-11-27T18:47:01.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18402024-11-27T18:47:01.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18412024-11-27T18:47:01.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18422024-11-27T18:47:01.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 097aad34-aef6-49d4-a0a1-23f4efd53bf1, lookup_type: ById(097aad34-aef6-49d4-a0a1-23f4efd53bf1) }, key: 48ce581b-0a1c-4f72-b0e2-dbd5e0eb7518, lookup_type: ById(48ce581b-0a1c-4f72-b0e2-dbd5e0eb7518) }, key: 97a6e3ad-ebcf-4655-b068-a4bd116f2ef3, lookup_type: ById(97a6e3ad-ebcf-4655-b068-a4bd116f2ef3) } result = Ok(())
18432024-11-27T18:47:01.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18442024-11-27T18:47:01.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18452024-11-27T18:47:01.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18462024-11-27T18:47:01.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18472024-11-27T18:47:01.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18482024-11-27T18:47:01.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18492024-11-27T18:47:01.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18502024-11-27T18:47:01.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18512024-11-27T18:47:01.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18522024-11-27T18:47:01.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18532024-11-27T18:47:01.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18542024-11-27T18:47:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18552024-11-27T18:47:01.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18562024-11-27T18:47:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18572024-11-27T18:47:01.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18582024-11-27T18:47:01.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18592024-11-27T18:47:01.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18602024-11-27T18:47:01.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 097aad34-aef6-49d4-a0a1-23f4efd53bf1, lookup_type: ById(097aad34-aef6-49d4-a0a1-23f4efd53bf1) }, key: 48ce581b-0a1c-4f72-b0e2-dbd5e0eb7518, lookup_type: ById(48ce581b-0a1c-4f72-b0e2-dbd5e0eb7518) }, key: 2eaced99-41ea-4d4f-8732-9b0c48374465, lookup_type: ByName("default") } result = Ok(())
18612024-11-27T18:47:01.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18622024-11-27T18:47:01.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18632024-11-27T18:47:01.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18642024-11-27T18:47:01.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18652024-11-27T18:47:01.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18662024-11-27T18:47:01.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18672024-11-27T18:47:01.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18682024-11-27T18:47:01.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18692024-11-27T18:47:01.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18702024-11-27T18:47:01.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18712024-11-27T18:47:01.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18722024-11-27T18:47:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18732024-11-27T18:47:01.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18742024-11-27T18:47:01.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18752024-11-27T18:47:01.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18762024-11-27T18:47:01.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 097aad34-aef6-49d4-a0a1-23f4efd53bf1, lookup_type: ById(097aad34-aef6-49d4-a0a1-23f4efd53bf1) }, key: 48ce581b-0a1c-4f72-b0e2-dbd5e0eb7518, lookup_type: ById(48ce581b-0a1c-4f72-b0e2-dbd5e0eb7518) }, key: bfe35947-9ebe-4f69-997e-18fe90f93616, lookup_type: ByName("default") } result = Ok(())
18772024-11-27T18:47:01.794ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18782024-11-27T18:47:01.794ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18792024-11-27T18:47:01.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7dc7daff-7d3e-4aeb-aa13-64ad44d1ffa1", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
18802024-11-27T18:47:01.802ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
18812024-11-27T18:47:01.802ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18822024-11-27T18:47:01.803ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "23326c2d-5ce3-452b-8d5d-a04102164628", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
18832024-11-27T18:47:01.803ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f2830ba-ab29-478c-ac7b-0a23d326e4ca", "content-length": "682", "date": "Wed, 27 Nov 2024 18:47:01 GMT"} })
18842024-11-27T18:47:01.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18852024-11-27T18:47:01.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18862024-11-27T18:47:01.804ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 411.104933ms iteration = 26 status = {}
18872024-11-27T18:47:01.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18882024-11-27T18:47:01.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18892024-11-27T18:47:01.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18902024-11-27T18:47:01.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18912024-11-27T18:47:01.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18922024-11-27T18:47:01.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18932024-11-27T18:47:01.819ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 425.804081ms iteration = 26 status = {}
18942024-11-27T18:47:02.413ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "342c5f1b-8796-46e9-b97f-bc637e7c7646", "content-length": "131", "date": "Wed, 27 Nov 2024 18:47:02 GMT"} })
18952024-11-27T18:47:02.424ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 sled_id = b844cfb5-ff43-41f6-a61d-f7949f48466b state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-27T18:46:54.298081974Z }, migration_in: None, migration_out: None } vmm_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7
18962024-11-27T18:47:02.424ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7 sled_id = b844cfb5-ff43-41f6-a61d-f7949f48466b vmm_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-27T18:46:54.298081974Z }
18972024-11-27T18:47:02.424ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 roles = RoleSet { roles: {} } sled_id = b844cfb5-ff43-41f6-a61d-f7949f48466b vmm_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7
18982024-11-27T18:47:02.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 resource = Database result = Ok(()) sled_id = b844cfb5-ff43-41f6-a61d-f7949f48466b vmm_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7
18992024-11-27T18:47:02.431ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7 remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b16e55bd-f331-4e76-818d-baa84162f6ce uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-27T18:47:02.413877526Z }
19002024-11-27T18:47:02.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b16e55bd-f331-4e76-818d-baa84162f6ce roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19012024-11-27T18:47:02.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b16e55bd-f331-4e76-818d-baa84162f6ce resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19022024-11-27T18:47:02.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26526 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b16e55bd-f331-4e76-818d-baa84162f6ce response_code = 204 uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19032024-11-27T18:47:02.443ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7 remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e73b55a0-16a7-4724-899f-9d0f2468b808 uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-27T18:47:02.443764499Z }
19042024-11-27T18:47:02.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e73b55a0-16a7-4724-899f-9d0f2468b808 roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19052024-11-27T18:47:02.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e73b55a0-16a7-4724-899f-9d0f2468b808 resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19062024-11-27T18:47:02.463ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
19072024-11-27T18:47:02.464ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.069986789s iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
19082024-11-27T18:47:02.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31842 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e73b55a0-16a7-4724-899f-9d0f2468b808 response_code = 204 uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19092024-11-27T18:47:02.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 299a9092-327d-4901-ba3b-ef1b92e00779 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19102024-11-27T18:47:02.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 299a9092-327d-4901-ba3b-ef1b92e00779 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19112024-11-27T18:47:02.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 299a9092-327d-4901-ba3b-ef1b92e00779 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19122024-11-27T18:47:03.592ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7590 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = b1b1e765-01e7-43e3-be32-b540d27a8892 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
19132024-11-27T18:47:03.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cf319e4f-9857-4644-b258-6c32c8ffd2d5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19142024-11-27T18:47:03.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cf319e4f-9857-4644-b258-6c32c8ffd2d5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19152024-11-27T18:47:03.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cf319e4f-9857-4644-b258-6c32c8ffd2d5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19162024-11-27T18:47:04.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1faa508a-8bcb-4f13-9f28-6a7d0eeb05e8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19172024-11-27T18:47:04.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1faa508a-8bcb-4f13-9f28-6a7d0eeb05e8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19182024-11-27T18:47:04.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1faa508a-8bcb-4f13-9f28-6a7d0eeb05e8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19192024-11-27T18:47:05.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1a440819-0c11-45a2-a5a9-e100e48e3a00 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19202024-11-27T18:47:05.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1a440819-0c11-45a2-a5a9-e100e48e3a00 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19212024-11-27T18:47:05.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1a440819-0c11-45a2-a5a9-e100e48e3a00 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19222024-11-27T18:47:06.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c7fab65-a445-493d-ab74-d47ea7f172fc roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19232024-11-27T18:47:06.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c7fab65-a445-493d-ab74-d47ea7f172fc resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19242024-11-27T18:47:06.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c7fab65-a445-493d-ab74-d47ea7f172fc response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19252024-11-27T18:47:07.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bf202e25-e586-439d-b9cf-618c6b303a0b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19262024-11-27T18:47:07.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bf202e25-e586-439d-b9cf-618c6b303a0b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19272024-11-27T18:47:07.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bf202e25-e586-439d-b9cf-618c6b303a0b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19282024-11-27T18:47:08.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1d180e53-09fb-44bd-add5-788e49133b23 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19292024-11-27T18:47:08.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1d180e53-09fb-44bd-add5-788e49133b23 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19302024-11-27T18:47:08.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1d180e53-09fb-44bd-add5-788e49133b23 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19312024-11-27T18:47:09.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 56430f4c-265f-40dc-a548-ec8de0a8636f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19322024-11-27T18:47:09.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 56430f4c-265f-40dc-a548-ec8de0a8636f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19332024-11-27T18:47:09.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 56430f4c-265f-40dc-a548-ec8de0a8636f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19342024-11-27T18:47:10.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3687f72d-e2a8-41ab-b16a-6fc6475b00cf roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19352024-11-27T18:47:10.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3687f72d-e2a8-41ab-b16a-6fc6475b00cf resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19362024-11-27T18:47:10.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3687f72d-e2a8-41ab-b16a-6fc6475b00cf response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19372024-11-27T18:47:11.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
19382024-11-27T18:47:11.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19392024-11-27T18:47:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19402024-11-27T18:47:11.395ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
19412024-11-27T18:47:11.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19422024-11-27T18:47:11.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19432024-11-27T18:47:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19442024-11-27T18:47:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19452024-11-27T18:47:11.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19462024-11-27T18:47:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19472024-11-27T18:47:11.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19482024-11-27T18:47:11.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19492024-11-27T18:47:11.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19502024-11-27T18:47:11.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
19512024-11-27T18:47:11.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19522024-11-27T18:47:11.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19532024-11-27T18:47:11.416ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
19542024-11-27T18:47:11.416ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.94638ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
19552024-11-27T18:47:11.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19562024-11-27T18:47:11.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19572024-11-27T18:47:11.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.03585ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19582024-11-27T18:47:11.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95feb802-99de-48b4-8437-20688fd85f72 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19592024-11-27T18:47:11.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95feb802-99de-48b4-8437-20688fd85f72 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19602024-11-27T18:47:11.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95feb802-99de-48b4-8437-20688fd85f72 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19612024-11-27T18:47:11.932ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7 remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 436260f1-bab1-41b2-a9e5-db83745060e8 uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-27T18:47:11.932580341Z }
19622024-11-27T18:47:11.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 436260f1-bab1-41b2-a9e5-db83745060e8 roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19632024-11-27T18:47:11.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 436260f1-bab1-41b2-a9e5-db83745060e8 resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19642024-11-27T18:47:11.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9298 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 436260f1-bab1-41b2-a9e5-db83745060e8 response_code = 204 uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19652024-11-27T18:47:12.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 81e1ec0a-3902-406c-b674-12302a6c5e93 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19662024-11-27T18:47:12.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 81e1ec0a-3902-406c-b674-12302a6c5e93 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19672024-11-27T18:47:12.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 81e1ec0a-3902-406c-b674-12302a6c5e93 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19682024-11-27T18:47:13.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3bba562d-b5f0-4ab1-b5c1-e69bc3eced11 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
19692024-11-27T18:47:13.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3bba562d-b5f0-4ab1-b5c1-e69bc3eced11 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
19702024-11-27T18:47:13.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3bba562d-b5f0-4ab1-b5c1-e69bc3eced11 response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
19712024-11-27T18:47:13.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 21addc77-ffad-4141-a36b-94178cfd56af roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
19722024-11-27T18:47:13.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 21addc77-ffad-4141-a36b-94178cfd56af resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
19732024-11-27T18:47:13.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 21addc77-ffad-4141-a36b-94178cfd56af response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
19742024-11-27T18:47:13.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 620 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = f6422b39-09df-42dc-a11c-dbf187e7092c response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
19752024-11-27T18:47:13.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 145c612b-ed82-40aa-8be1-fa6d76bbdc16 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19762024-11-27T18:47:13.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 145c612b-ed82-40aa-8be1-fa6d76bbdc16 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19772024-11-27T18:47:13.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 145c612b-ed82-40aa-8be1-fa6d76bbdc16 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
19782024-11-27T18:47:14.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 65e5ac5f-5e66-49fa-ace4-97ea6f04b8a4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
19792024-11-27T18:47:14.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 65e5ac5f-5e66-49fa-ace4-97ea6f04b8a4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
19802024-11-27T18:47:14.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 65e5ac5f-5e66-49fa-ace4-97ea6f04b8a4 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
19812024-11-27T18:47:14.334ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7 remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-27T18:47:14.333704100Z }
19822024-11-27T18:47:14.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19832024-11-27T18:47:14.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19842024-11-27T18:47:14.345ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7 remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7 vmm_needs_update = true
19852024-11-27T18:47:14.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19862024-11-27T18:47:14.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19872024-11-27T18:47:14.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19882024-11-27T18:47:14.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19892024-11-27T18:47:14.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19902024-11-27T18:47:14.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19912024-11-27T18:47:14.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19922024-11-27T18:47:14.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19932024-11-27T18:47:14.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19942024-11-27T18:47:14.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19952024-11-27T18:47:14.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19962024-11-27T18:47:14.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19972024-11-27T18:47:14.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19982024-11-27T18:47:14.365ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 097aad34-aef6-49d4-a0a1-23f4efd53bf1, lookup_type: ById(097aad34-aef6-49d4-a0a1-23f4efd53bf1) }, key: 6f35a23e-154e-4f2b-935a-ce5c847b6708, lookup_type: ById(6f35a23e-154e-4f2b-935a-ce5c847b6708) } result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
19992024-11-27T18:47:14.370ZINFOnexus (dropshot_internal): starting update saga for 6f35a23e-154e-4f2b-935a-ce5c847b6708 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-27T18:47:14.333704100Z }
20002024-11-27T18:47:14.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36329 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a response_code = 204 uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
20012024-11-27T18:47:14.370ZDEBGnexus (dropshot_internal): preparing instance-update saga for 6f35a23e-154e-4f2b-935a-ce5c847b6708... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 729c5d3c-59af-4b3b-859e-64ed3048805a uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
20022024-11-27T18:47:14.370ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update
20032024-11-27T18:47:14.370ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7 remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b2ffa42-3ca9-4095-a2ea-afb741902167 uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-27T18:47:14.333704100Z }
20042024-11-27T18:47:14.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b2ffa42-3ca9-4095-a2ea-afb741902167 roles = RoleSet { roles: {} } uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
20052024-11-27T18:47:14.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b2ffa42-3ca9-4095-a2ea-afb741902167 resource = Database result = Ok(()) uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
20062024-11-27T18:47:14.372ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"6f35a23e-154e-4f2b-935a-ce5c847b6708","lookup_type":{"ById":"6f35a23e-154e-4f2b-935a-ce5c847b6708"},"parent":{"key":"097aad34-aef6-49d4-a0a1-23f4efd53bf1","lookup_type":{"ById":"097aad34-aef6-49d4-a0a1-23f4efd53bf1"},"parent":{"key":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","lookup_type":{"ById":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20072024-11-27T18:47:14.372ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update
20082024-11-27T18:47:14.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6257 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b2ffa42-3ca9-4095-a2ea-afb741902167 response_code = 204 uri = /vmms/2250b489-f327-4f8d-bb09-fbdbb9a206c7
20092024-11-27T18:47:14.411ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update
20102024-11-27T18:47:14.411ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20112024-11-27T18:47:14.411ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20122024-11-27T18:47:14.411ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
20132024-11-27T18:47:14.422ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20142024-11-27T18:47:14.423ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
20152024-11-27T18:47:14.435ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20162024-11-27T18:47:14.435ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
20172024-11-27T18:47:14.444ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20182024-11-27T18:47:14.444ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("dc77b356-bd56-4e42-ad9b-a22ed68c7228")) node_id = 0 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
20192024-11-27T18:47:14.448ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20202024-11-27T18:47:14.448ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
20212024-11-27T18:47:14.465ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update
20222024-11-27T18:47:14.470ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20232024-11-27T18:47:14.470ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20242024-11-27T18:47:14.472ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20252024-11-27T18:47:14.472ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20262024-11-27T18:47:14.474ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20272024-11-27T18:47:14.474ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20282024-11-27T18:47:14.475ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20292024-11-27T18:47:14.475ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20302024-11-27T18:47:14.477ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20312024-11-27T18:47:14.477ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20322024-11-27T18:47:14.478ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20332024-11-27T18:47:14.478ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20342024-11-27T18:47:14.480ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20352024-11-27T18:47:14.483ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 097aad34-aef6-49d4-a0a1-23f4efd53bf1, lookup_type: ById(097aad34-aef6-49d4-a0a1-23f4efd53bf1) }, key: 6f35a23e-154e-4f2b-935a-ce5c847b6708, lookup_type: ById(6f35a23e-154e-4f2b-935a-ce5c847b6708) } result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20362024-11-27T18:47:14.483ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance updater_id = dc77b356-bd56-4e42-ad9b-a22ed68c7228
20372024-11-27T18:47:14.483ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20382024-11-27T18:47:14.483ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20392024-11-27T18:47:14.497ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance updater_id = dc77b356-bd56-4e42-ad9b-a22ed68c7228
20402024-11-27T18:47:14.497ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20412024-11-27T18:47:14.497ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance
20422024-11-27T18:47:14.504ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 locked_gen = Generation(Generation(2)) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = LockInstance updater_id = dc77b356-bd56-4e42-ad9b-a22ed68c7228
20432024-11-27T18:47:14.506ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20442024-11-27T18:47:14.506ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("dc77b356-bd56-4e42-ad9b-a22ed68c7228")}) node_id = 1 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
20452024-11-27T18:47:14.510ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20462024-11-27T18:47:14.510ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
20472024-11-27T18:47:14.521ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20482024-11-27T18:47:14.521ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20492024-11-27T18:47:14.523ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20502024-11-27T18:47:14.523ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20512024-11-27T18:47:14.525ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20522024-11-27T18:47:14.525ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20532024-11-27T18:47:14.526ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20542024-11-27T18:47:14.529ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 097aad34-aef6-49d4-a0a1-23f4efd53bf1, lookup_type: ById(097aad34-aef6-49d4-a0a1-23f4efd53bf1) }, key: 6f35a23e-154e-4f2b-935a-ce5c847b6708, lookup_type: ById(6f35a23e-154e-4f2b-935a-ce5c847b6708) } result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20552024-11-27T18:47:14.529ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20562024-11-27T18:47:14.529ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20572024-11-27T18:47:14.539ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 2250b489-f327-4f8d-bb09-fbdbb9a206c7, time_created: 2024-11-27T18:46:53.821910Z, time_deleted: None, instance_id: 6f35a23e-154e-4f2b-935a-ce5c847b6708, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-27T18:47:14.333704Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-27T18:46:51.760937Z, gen: Generation(Generation(3)), propolis_id: Some(2250b489-f327-4f8d-bb09-fbdbb9a206c7), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(2250b489-f327-4f8d-bb09-fbdbb9a206c7 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-27T18:47:14.539390389Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
20582024-11-27T18:47:14.544ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
20592024-11-27T18:47:14.546ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"6f35a23e-154e-4f2b-935a-ce5c847b6708","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"2250b489-f327-4f8d-bb09-fbdbb9a206c7"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"6f35a23e-154e-4f2b-935a-ce5c847b6708","lookup_type":{"ById":"6f35a23e-154e-4f2b-935a-ce5c847b6708"},"parent":{"key":"097aad34-aef6-49d4-a0a1-23f4efd53bf1","lookup_type":{"ById":"097aad34-aef6-49d4-a0a1-23f4efd53bf1"},"parent":{"key":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","lookup_type":{"ById":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"dc77b356-bd56-4e42-ad9b-a22ed68c7228"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"097aad34-aef6-49d4-a0a1-23f4efd53bf1","ram_diff":1073741824},"destroy_active_vmm":"2250b489-f327-4f8d-bb09-fbdbb9a206c7","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-27T18:47:14.539390389Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20602024-11-27T18:47:14.546ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
20612024-11-27T18:47:14.551ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
20622024-11-27T18:47:14.551ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20632024-11-27T18:47:14.551ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20642024-11-27T18:47:14.551ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
20652024-11-27T18:47:14.557ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20662024-11-27T18:47:14.557ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
20672024-11-27T18:47:14.562ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20682024-11-27T18:47:14.562ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
20692024-11-27T18:47:14.566ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20702024-11-27T18:47:14.566ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("bf254d74-c5f5-429f-94ea-680d9a65fe2a")) node_id = 0 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
20712024-11-27T18:47:14.570ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20722024-11-27T18:47:14.570ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
20732024-11-27T18:47:14.576ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 parent_lock = UpdaterLock { updater_id: dc77b356-bd56-4e42-ad9b-a22ed68c7228, locked_gen: Generation(Generation(2)) } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
20742024-11-27T18:47:14.576ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = BecomeUpdater
20752024-11-27T18:47:14.576ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = BecomeUpdater
20762024-11-27T18:47:14.587ZDEBGnexus (SagaExecutor): inherited lock from dc77b356-bd56-4e42-ad9b-a22ed68c7228 to bf254d74-c5f5-429f-94ea-680d9a65fe2a actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = dc77b356-bd56-4e42-ad9b-a22ed68c7228 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = BecomeUpdater updater_id = bf254d74-c5f5-429f-94ea-680d9a65fe2a
20772024-11-27T18:47:14.587ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
20782024-11-27T18:47:14.587ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20792024-11-27T18:47:14.587ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("bf254d74-c5f5-429f-94ea-680d9a65fe2a")}) node_id = 1 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
20802024-11-27T18:47:14.590ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20812024-11-27T18:47:14.590ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
20822024-11-27T18:47:14.593ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20832024-11-27T18:47:14.593ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
20842024-11-27T18:47:14.596ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
20852024-11-27T18:47:14.596ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
20862024-11-27T18:47:14.599ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
20872024-11-27T18:47:14.601ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708
20882024-11-27T18:47:14.601ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = UpdateNetworkConfig
20892024-11-27T18:47:14.601ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = UpdateNetworkConfig
20902024-11-27T18:47:14.605ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = UpdateNetworkConfig
20912024-11-27T18:47:14.605ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = UpdateNetworkConfig
20922024-11-27T18:47:14.612ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
20932024-11-27T18:47:14.612ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = UpdateNetworkConfig
20942024-11-27T18:47:14.612ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = UpdateNetworkConfig
20952024-11-27T18:47:14.614ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
20962024-11-27T18:47:14.614ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
20972024-11-27T18:47:14.615ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
20982024-11-27T18:47:14.616ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
20992024-11-27T18:47:14.617ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
21002024-11-27T18:47:14.617ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
21012024-11-27T18:47:14.617ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
21022024-11-27T18:47:14.624ZDEBGnexus: notifying dendrite of updates instance_id = Some(6f35a23e-154e-4f2b-935a-ce5c847b6708 (instance)) switch = switch0
21032024-11-27T18:47:14.624ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2868, tv_nsec: 619565899 } })
21042024-11-27T18:47:14.624ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
21052024-11-27T18:47:14.654ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21062024-11-27T18:47:14.654ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21072024-11-27T18:47:14.655ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38008672-deff-4f48-bc04-5026c26b156d", "content-length": "26", "date": "Wed, 27 Nov 2024 18:47:14 GMT"} })
21082024-11-27T18:47:14.655ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21092024-11-27T18:47:14.655ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21102024-11-27T18:47:14.687ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
21112024-11-27T18:47:14.687ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cbd5a2e-6616-497d-a395-9e3c2e2b44ba", "content-length": "4", "date": "Wed, 27 Nov 2024 18:47:14 GMT"} })
21122024-11-27T18:47:14.687ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21132024-11-27T18:47:14.687ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21142024-11-27T18:47:14.692ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21152024-11-27T18:47:14.692ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21162024-11-27T18:47:14.703ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ReleaseVirtualProvisioning
21172024-11-27T18:47:14.703ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ReleaseVirtualProvisioning
21182024-11-27T18:47:14.729ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-27T18:47:14.707049Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 097aad34-aef6-49d4-a0a1-23f4efd53bf1, time_modified: Some(2024-11-27T18:47:14.707049Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, time_modified: Some(2024-11-27T18:47:14.707049Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
21192024-11-27T18:47:14.729ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21202024-11-27T18:47:14.729ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21212024-11-27T18:47:14.739ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21222024-11-27T18:47:14.739ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21232024-11-27T18:47:14.746ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
21242024-11-27T18:47:14.746ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = UnassignOximeterProducer
21252024-11-27T18:47:14.746ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = UnassignOximeterProducer
21262024-11-27T18:47:14.754ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 producer_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
21272024-11-27T18:47:14.754ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = UnassignOximeterProducer
21282024-11-27T18:47:14.754ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = UnassignOximeterProducer
21292024-11-27T18:47:14.789ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
21302024-11-27T18:47:14.791ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/6f35a23e-154e-4f2b-935a-ce5c847b6708
21312024-11-27T18:47:14.808ZDEBGnexus (SagaExecutor): client response oximeter-collector = 6f35a23e-154e-4f2b-935a-ce5c847b6708 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/6f35a23e-154e-4f2b-935a-ce5c847b6708", status: 204, headers: {"x-request-id": "412a6da7-80c5-4262-a769-f4475a25c94f", "date": "Wed, 27 Nov 2024 18:47:14 GMT"} }) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
21322024-11-27T18:47:14.808ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 producer_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
21332024-11-27T18:47:14.810ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21342024-11-27T18:47:14.810ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21352024-11-27T18:47:14.815ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21362024-11-27T18:47:14.815ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21372024-11-27T18:47:14.819ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 lock = UpdaterLock { updater_id: bf254d74-c5f5-429f-94ea-680d9a65fe2a, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-27T18:47:14.539390389Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
21382024-11-27T18:47:14.819ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = CommitInstanceUpdates
21392024-11-27T18:47:14.820ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = CommitInstanceUpdates
21402024-11-27T18:47:14.855ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 new_runtime = InstanceRuntimeState { time_updated: 2024-11-27T18:47:14.539390389Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
21412024-11-27T18:47:14.855ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21422024-11-27T18:47:14.855ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21432024-11-27T18:47:14.855ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Signaled
21442024-11-27T18:47:14.855ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
21452024-11-27T18:47:14.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21462024-11-27T18:47:14.855ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
21472024-11-27T18:47:14.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21482024-11-27T18:47:14.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21492024-11-27T18:47:14.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21502024-11-27T18:47:14.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21512024-11-27T18:47:14.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21522024-11-27T18:47:14.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21532024-11-27T18:47:14.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21542024-11-27T18:47:14.859ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21552024-11-27T18:47:14.859ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21562024-11-27T18:47:14.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21572024-11-27T18:47:14.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21582024-11-27T18:47:14.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21592024-11-27T18:47:14.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21602024-11-27T18:47:14.862ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21612024-11-27T18:47:14.862ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("6f35a23e-154e-4f2b-935a-ce5c847b6708"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2250b489-f327-4f8d-bb09-fbdbb9a206c7")}) node_id = 7 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21622024-11-27T18:47:14.866ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21632024-11-27T18:47:14.866ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21642024-11-27T18:47:14.868ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21652024-11-27T18:47:14.869ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21662024-11-27T18:47:14.872ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21672024-11-27T18:47:14.872ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21682024-11-27T18:47:14.876ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 propolis_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
21692024-11-27T18:47:14.876ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ReleaseSledResources
21702024-11-27T18:47:14.876ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ReleaseSledResources
21712024-11-27T18:47:14.895ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21722024-11-27T18:47:14.895ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21732024-11-27T18:47:14.895ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "10391124-7142-4a73-9eb7-4118d11ddd4a", "content-length": "372", "date": "Wed, 27 Nov 2024 18:47:14 GMT"} })
21742024-11-27T18:47:14.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21752024-11-27T18:47:14.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21762024-11-27T18:47:14.899ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21772024-11-27T18:47:14.899ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21782024-11-27T18:47:14.902ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21792024-11-27T18:47:14.902ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21802024-11-27T18:47:14.905ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 propolis_id = 2250b489-f327-4f8d-bb09-fbdbb9a206c7 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
21812024-11-27T18:47:14.905ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = MarkVmmDeleted
21822024-11-27T18:47:14.906ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = MarkVmmDeleted
21832024-11-27T18:47:14.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = db32801d-9348-4d7b-bdc5-f4af92412543 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
21842024-11-27T18:47:14.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = db32801d-9348-4d7b-bdc5-f4af92412543 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
21852024-11-27T18:47:14.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = db32801d-9348-4d7b-bdc5-f4af92412543 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
21862024-11-27T18:47:14.942ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {f69caef5-cd3e-4773-91ca-a68c04f4a199: {10.151.2.175: {bfe35947-9ebe-4f69-997e-18fe90f93616}, 10.151.2.176: {bfe35947-9ebe-4f69-997e-18fe90f93616}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
21872024-11-27T18:47:14.942ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21882024-11-27T18:47:14.946ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "46df3c20-0063-43b7-acd2-f48bf1d84e7b", "date": "Wed, 27 Nov 2024 18:47:14 GMT"} })
21892024-11-27T18:47:14.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21902024-11-27T18:47:14.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21912024-11-27T18:47:14.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21922024-11-27T18:47:14.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21932024-11-27T18:47:14.951ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
21942024-11-27T18:47:14.951ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
21952024-11-27T18:47:14.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21962024-11-27T18:47:14.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21972024-11-27T18:47:14.955ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21982024-11-27T18:47:14.955ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21992024-11-27T18:47:14.955ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "53fc6139-0bb2-47be-8626-3cd451046f64", "date": "Wed, 27 Nov 2024 18:47:14 GMT"} })
22002024-11-27T18:47:14.956ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22012024-11-27T18:47:14.956ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
22022024-11-27T18:47:14.956ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 101.495794ms iteration = 27 status = {}
22032024-11-27T18:47:14.960ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22042024-11-27T18:47:14.960ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
22052024-11-27T18:47:14.964ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22062024-11-27T18:47:14.964ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
22072024-11-27T18:47:14.966ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ChainSuccessorSaga
22082024-11-27T18:47:14.967ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ChainSuccessorSaga
22092024-11-27T18:47:14.968ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ChainSuccessorSaga
22102024-11-27T18:47:14.968ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ChainSuccessorSaga
22112024-11-27T18:47:14.969ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ChainSuccessorSaga
22122024-11-27T18:47:14.970ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ChainSuccessorSaga
22132024-11-27T18:47:14.971ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ChainSuccessorSaga
22142024-11-27T18:47:14.974ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 097aad34-aef6-49d4-a0a1-23f4efd53bf1, lookup_type: ById(097aad34-aef6-49d4-a0a1-23f4efd53bf1) }, key: 6f35a23e-154e-4f2b-935a-ce5c847b6708, lookup_type: ById(6f35a23e-154e-4f2b-935a-ce5c847b6708) } result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ChainSuccessorSaga
22152024-11-27T18:47:14.974ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ChainSuccessorSaga
22162024-11-27T18:47:14.974ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_node = ChainSuccessorSaga
22172024-11-27T18:47:15.000ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update
22182024-11-27T18:47:15.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22192024-11-27T18:47:15.000ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22202024-11-27T18:47:15.000ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
22212024-11-27T18:47:15.000ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Signaled
22222024-11-27T18:47:15.000ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22232024-11-27T18:47:15.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22242024-11-27T18:47:15.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22252024-11-27T18:47:15.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22262024-11-27T18:47:15.004ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22272024-11-27T18:47:15.004ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
22282024-11-27T18:47:15.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22292024-11-27T18:47:15.004ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22302024-11-27T18:47:15.004ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
22312024-11-27T18:47:15.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22322024-11-27T18:47:15.006ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22332024-11-27T18:47:15.006ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22342024-11-27T18:47:15.006ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22352024-11-27T18:47:15.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22362024-11-27T18:47:15.008ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22372024-11-27T18:47:15.008ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
22382024-11-27T18:47:15.012ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22392024-11-27T18:47:15.012ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd
22402024-11-27T18:47:15.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = c9b87ec9-a183-4742-b9d3-f4d7521ddeb4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
22412024-11-27T18:47:15.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = c9b87ec9-a183-4742-b9d3-f4d7521ddeb4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
22422024-11-27T18:47:15.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = c9b87ec9-a183-4742-b9d3-f4d7521ddeb4 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
22432024-11-27T18:47:15.021ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22442024-11-27T18:47:15.021ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd saga_name = instance-update saga_result = SagaResult { saga_id: 6c01faf6-92a0-4e84-8708-eef8d87febfd, saga_log: SagaLog { saga_id: 6c01faf6-92a0-4e84-8708-eef8d87febfd, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("bf254d74-c5f5-429f-94ea-680d9a65fe2a")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("bf254d74-c5f5-429f-94ea-680d9a65fe2a")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("6f35a23e-154e-4f2b-935a-ce5c847b6708"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2250b489-f327-4f8d-bb09-fbdbb9a206c7")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("6f35a23e-154e-4f2b-935a-ce5c847b6708"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2250b489-f327-4f8d-bb09-fbdbb9a206c7")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("bf254d74-c5f5-429f-94ea-680d9a65fe2a"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("bf254d74-c5f5-429f-94ea-680d9a65fe2a")}} }) }
22452024-11-27T18:47:15.021ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 6c01faf6-92a0-4e84-8708-eef8d87febfd instance_id = 6f35a23e-154e-4f2b-935a-ce5c847b6708 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update
22462024-11-27T18:47:15.021ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22472024-11-27T18:47:15.021ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
22482024-11-27T18:47:15.025ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22492024-11-27T18:47:15.025ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
22502024-11-27T18:47:15.028ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22512024-11-27T18:47:15.028ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
22522024-11-27T18:47:15.031ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22532024-11-27T18:47:15.031ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205
22542024-11-27T18:47:15.036ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22552024-11-27T18:47:15.036ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22562024-11-27T18:47:15.036ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 36.100055ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22572024-11-27T18:47:15.037ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update sec_id = 236c7b74-8315-46e3-9a37-90380a675558
22582024-11-27T18:47:15.037ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = f41483b6-a7d7-4b56-8991-b1c64010d205 saga_name = start-instance-update saga_result = SagaResult { saga_id: f41483b6-a7d7-4b56-8991-b1c64010d205, saga_log: SagaLog { saga_id: f41483b6-a7d7-4b56-8991-b1c64010d205, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("dc77b356-bd56-4e42-ad9b-a22ed68c7228")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("dc77b356-bd56-4e42-ad9b-a22ed68c7228")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("dc77b356-bd56-4e42-ad9b-a22ed68c7228"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("dc77b356-bd56-4e42-ad9b-a22ed68c7228")}} }) }
22592024-11-27T18:47:15.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22602024-11-27T18:47:15.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22612024-11-27T18:47:15.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22622024-11-27T18:47:15.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22632024-11-27T18:47:15.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22642024-11-27T18:47:15.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22652024-11-27T18:47:15.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22662024-11-27T18:47:15.103ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22672024-11-27T18:47:15.103ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22682024-11-27T18:47:15.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22692024-11-27T18:47:15.138ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22702024-11-27T18:47:15.138ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c8eaa83-b475-4e41-91e2-f035de01b837", "content-length": "691", "date": "Wed, 27 Nov 2024 18:47:14 GMT"} })
22712024-11-27T18:47:15.138ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
22722024-11-27T18:47:15.138ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
22732024-11-27T18:47:15.138ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
22742024-11-27T18:47:15.140ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 285.291959ms iteration = 27 status = {}
22752024-11-27T18:47:15.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 74240e55-4726-46d2-af2b-9fd719e9dc3e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22762024-11-27T18:47:15.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 74240e55-4726-46d2-af2b-9fd719e9dc3e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22772024-11-27T18:47:15.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 74240e55-4726-46d2-af2b-9fd719e9dc3e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22782024-11-27T18:47:16.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ff1c87a3-1d89-4568-8e4b-e43e0478f2c0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22792024-11-27T18:47:16.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ff1c87a3-1d89-4568-8e4b-e43e0478f2c0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22802024-11-27T18:47:16.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ff1c87a3-1d89-4568-8e4b-e43e0478f2c0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22812024-11-27T18:47:18.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f9838577-26f4-4bf0-8674-4b511559cbbe roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22822024-11-27T18:47:18.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f9838577-26f4-4bf0-8674-4b511559cbbe resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22832024-11-27T18:47:18.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f9838577-26f4-4bf0-8674-4b511559cbbe response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22842024-11-27T18:47:19.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 73f5336d-e856-430f-a427-a9c7d68301d2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22852024-11-27T18:47:19.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 73f5336d-e856-430f-a427-a9c7d68301d2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22862024-11-27T18:47:19.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 73f5336d-e856-430f-a427-a9c7d68301d2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22872024-11-27T18:47:20.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9bb2ede9-face-427f-b909-f270f1277e44 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22882024-11-27T18:47:20.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9bb2ede9-face-427f-b909-f270f1277e44 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22892024-11-27T18:47:20.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9bb2ede9-face-427f-b909-f270f1277e44 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22902024-11-27T18:47:21.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2600e06a-9eec-431a-accf-09284665336f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22912024-11-27T18:47:21.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2600e06a-9eec-431a-accf-09284665336f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22922024-11-27T18:47:21.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2600e06a-9eec-431a-accf-09284665336f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
22932024-11-27T18:47:21.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
22942024-11-27T18:47:21.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22952024-11-27T18:47:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22962024-11-27T18:47:21.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
22972024-11-27T18:47:21.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22982024-11-27T18:47:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22992024-11-27T18:47:21.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23002024-11-27T18:47:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23012024-11-27T18:47:21.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23022024-11-27T18:47:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23032024-11-27T18:47:21.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23042024-11-27T18:47:21.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23052024-11-27T18:47:21.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23062024-11-27T18:47:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
23072024-11-27T18:47:21.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23082024-11-27T18:47:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23092024-11-27T18:47:21.416ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
23102024-11-27T18:47:21.416ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.109682ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
23112024-11-27T18:47:21.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23122024-11-27T18:47:21.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23132024-11-27T18:47:21.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.458327ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23142024-11-27T18:47:22.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e4293b7c-f8db-48bb-8ed5-b0762bab09ae roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23152024-11-27T18:47:22.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e4293b7c-f8db-48bb-8ed5-b0762bab09ae resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23162024-11-27T18:47:22.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e4293b7c-f8db-48bb-8ed5-b0762bab09ae response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23172024-11-27T18:47:23.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 40ef9ce4-1119-4910-a3be-1354d1a2f8d8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23182024-11-27T18:47:23.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 40ef9ce4-1119-4910-a3be-1354d1a2f8d8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23192024-11-27T18:47:23.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 40ef9ce4-1119-4910-a3be-1354d1a2f8d8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23202024-11-27T18:47:23.585ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 634 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 61f41b51-53e1-4ba6-9142-61323f9a86bc response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
23212024-11-27T18:47:24.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9715f1d4-d07e-42bd-8a6b-80bf171d8e78 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23222024-11-27T18:47:24.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9715f1d4-d07e-42bd-8a6b-80bf171d8e78 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23232024-11-27T18:47:24.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9715f1d4-d07e-42bd-8a6b-80bf171d8e78 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23242024-11-27T18:47:25.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 935f4114-7e06-4e2d-a8b9-5811cde3ff29 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23252024-11-27T18:47:25.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 935f4114-7e06-4e2d-a8b9-5811cde3ff29 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23262024-11-27T18:47:25.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 935f4114-7e06-4e2d-a8b9-5811cde3ff29 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23272024-11-27T18:47:26.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d7cb70d-21c2-4be0-a355-294e51181faf roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23282024-11-27T18:47:26.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d7cb70d-21c2-4be0-a355-294e51181faf resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23292024-11-27T18:47:26.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d7cb70d-21c2-4be0-a355-294e51181faf response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23302024-11-27T18:47:27.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82aa2ef9-a9d0-4409-971e-b16c09436fb5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23312024-11-27T18:47:27.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82aa2ef9-a9d0-4409-971e-b16c09436fb5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23322024-11-27T18:47:27.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82aa2ef9-a9d0-4409-971e-b16c09436fb5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23332024-11-27T18:47:28.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8f8e472-ecdd-4485-b77c-bba8986436e5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23342024-11-27T18:47:28.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8f8e472-ecdd-4485-b77c-bba8986436e5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23352024-11-27T18:47:28.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8f8e472-ecdd-4485-b77c-bba8986436e5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23362024-11-27T18:47:29.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 613af336-6a7f-46d5-9055-ad8450898c3c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23372024-11-27T18:47:29.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 613af336-6a7f-46d5-9055-ad8450898c3c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23382024-11-27T18:47:29.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 613af336-6a7f-46d5-9055-ad8450898c3c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23392024-11-27T18:47:30.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95380a7c-251a-4770-bbac-28e66175cd8b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23402024-11-27T18:47:30.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95380a7c-251a-4770-bbac-28e66175cd8b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23412024-11-27T18:47:30.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95380a7c-251a-4770-bbac-28e66175cd8b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23422024-11-27T18:47:31.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a164cd0c-e8c0-4718-aaa7-193ea72be14b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23432024-11-27T18:47:31.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a164cd0c-e8c0-4718-aaa7-193ea72be14b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23442024-11-27T18:47:31.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a164cd0c-e8c0-4718-aaa7-193ea72be14b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
23452024-11-27T18:47:31.393ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
23462024-11-27T18:47:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
23472024-11-27T18:47:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23482024-11-27T18:47:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
23492024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23502024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23512024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
23522024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
23532024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23542024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23552024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
23562024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23572024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
23582024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
23592024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23602024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23612024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
23622024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
23632024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23642024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
23652024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23662024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
23672024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23682024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
23692024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
23702024-11-27T18:47:31.394ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:37:31.394167239 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23712024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23722024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
23732024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23742024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23752024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
23762024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23772024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
23782024-11-27T18:47:31.394ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23792024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23802024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
23812024-11-27T18:47:31.394ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
23822024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23832024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.241\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
23842024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
23852024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23862024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
23872024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23882024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
23892024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
23902024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23912024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23922024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23932024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
23942024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23952024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
23962024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23972024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
23982024-11-27T18:47:31.394ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23992024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24002024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
24012024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24022024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
24032024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24042024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
24052024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
24062024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
24072024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
24082024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24092024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24102024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24112024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24122024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24132024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24142024-11-27T18:47:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24152024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24162024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24172024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24182024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24192024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24202024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24212024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24222024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24232024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24242024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24252024-11-27T18:47:31.395ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2885, tv_nsec: 389994530 } })
24262024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24272024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24282024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24292024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24302024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24312024-11-27T18:47:31.395ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2885, tv_nsec: 390059711 } })
24322024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24332024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
24342024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.233779ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
24352024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
24362024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.206188ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
24372024-11-27T18:47:31.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24382024-11-27T18:47:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24392024-11-27T18:47:31.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24402024-11-27T18:47:31.398ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.240703ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24412024-11-27T18:47:31.399ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2885, tv_nsec: 394164961 } })
24422024-11-27T18:47:31.399ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
24432024-11-27T18:47:31.399ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.593513ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
24442024-11-27T18:47:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24452024-11-27T18:47:31.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24462024-11-27T18:47:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24472024-11-27T18:47:31.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24482024-11-27T18:47:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24492024-11-27T18:47:31.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24502024-11-27T18:47:31.402ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:37:31.394167239 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24512024-11-27T18:47:31.402ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.390375ms iteration = 14 status = {"expiration":"2024-11-27T18:37:31.394167239Z","pruned":[]}
24522024-11-27T18:47:31.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24532024-11-27T18:47:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24542024-11-27T18:47:31.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24552024-11-27T18:47:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24562024-11-27T18:47:31.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24572024-11-27T18:47:31.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24582024-11-27T18:47:31.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24592024-11-27T18:47:31.408ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24602024-11-27T18:47:31.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24612024-11-27T18:47:31.410ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24622024-11-27T18:47:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24632024-11-27T18:47:31.413ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24642024-11-27T18:47:31.414ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2885, tv_nsec: 409064562 } })
24652024-11-27T18:47:31.414ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
24662024-11-27T18:47:31.414ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24672024-11-27T18:47:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24682024-11-27T18:47:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24692024-11-27T18:47:31.416ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24702024-11-27T18:47:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24712024-11-27T18:47:31.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24722024-11-27T18:47:31.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24732024-11-27T18:47:31.419ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24742024-11-27T18:47:31.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24752024-11-27T18:47:31.426ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24762024-11-27T18:47:31.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24772024-11-27T18:47:31.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.88386ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
24782024-11-27T18:47:31.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24792024-11-27T18:47:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24802024-11-27T18:47:31.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24812024-11-27T18:47:31.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.109883ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
24822024-11-27T18:47:31.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24832024-11-27T18:47:31.441ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24842024-11-27T18:47:31.441ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24852024-11-27T18:47:31.441ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 47.434013ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24862024-11-27T18:47:31.442ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24872024-11-27T18:47:31.443ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24882024-11-27T18:47:31.443ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24892024-11-27T18:47:31.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24902024-11-27T18:47:31.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24912024-11-27T18:47:31.448ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24922024-11-27T18:47:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24932024-11-27T18:47:31.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24942024-11-27T18:47:31.451ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24952024-11-27T18:47:31.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24962024-11-27T18:47:31.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24972024-11-27T18:47:31.455ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24982024-11-27T18:47:31.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24992024-11-27T18:47:31.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25002024-11-27T18:47:31.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25012024-11-27T18:47:31.456ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25022024-11-27T18:47:31.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25032024-11-27T18:47:31.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25042024-11-27T18:47:31.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25052024-11-27T18:47:31.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.771435ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25062024-11-27T18:47:31.458ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25072024-11-27T18:47:31.458ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.807896ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
25082024-11-27T18:47:31.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25092024-11-27T18:47:31.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25102024-11-27T18:47:31.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25112024-11-27T18:47:31.461ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 67.604722ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25122024-11-27T18:47:31.462ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25132024-11-27T18:47:31.463ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2885, tv_nsec: 458715898 } })
25142024-11-27T18:47:31.464ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
25152024-11-27T18:47:31.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25162024-11-27T18:47:31.464ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25172024-11-27T18:47:31.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25182024-11-27T18:47:31.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192024-11-27T18:47:31.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25202024-11-27T18:47:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25212024-11-27T18:47:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25222024-11-27T18:47:31.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25232024-11-27T18:47:31.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25242024-11-27T18:47:31.475ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25252024-11-27T18:47:31.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25262024-11-27T18:47:31.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25272024-11-27T18:47:31.479ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25282024-11-27T18:47:31.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25292024-11-27T18:47:31.480ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25302024-11-27T18:47:31.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25312024-11-27T18:47:31.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
25322024-11-27T18:47:31.481ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25332024-11-27T18:47:31.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25342024-11-27T18:47:31.483ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25352024-11-27T18:47:31.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25362024-11-27T18:47:31.484ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.339839ms iteration = 27 status = 0
25372024-11-27T18:47:31.484ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25382024-11-27T18:47:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
25392024-11-27T18:47:31.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25402024-11-27T18:47:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25412024-11-27T18:47:31.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25422024-11-27T18:47:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25432024-11-27T18:47:31.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25442024-11-27T18:47:31.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.883225ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25452024-11-27T18:47:31.497ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25462024-11-27T18:47:31.498ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25472024-11-27T18:47:31.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25482024-11-27T18:47:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25492024-11-27T18:47:31.498ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25502024-11-27T18:47:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25512024-11-27T18:47:31.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25522024-11-27T18:47:31.499ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25532024-11-27T18:47:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25542024-11-27T18:47:31.503ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
25552024-11-27T18:47:31.503ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 109.25906ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
25562024-11-27T18:47:31.509ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25572024-11-27T18:47:31.509ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25582024-11-27T18:47:31.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25592024-11-27T18:47:31.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25602024-11-27T18:47:31.510ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25612024-11-27T18:47:31.510ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25622024-11-27T18:47:31.510ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.400296ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25632024-11-27T18:47:31.511ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25642024-11-27T18:47:31.511ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25652024-11-27T18:47:31.511ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25662024-11-27T18:47:31.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25672024-11-27T18:47:31.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25682024-11-27T18:47:31.512ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25692024-11-27T18:47:31.512ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25702024-11-27T18:47:31.512ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25712024-11-27T18:47:31.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25722024-11-27T18:47:31.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25732024-11-27T18:47:31.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25742024-11-27T18:47:31.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25752024-11-27T18:47:31.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25762024-11-27T18:47:31.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25772024-11-27T18:47:31.525ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
25782024-11-27T18:47:31.525ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 130.961442ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
25792024-11-27T18:47:31.528ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.86471ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25802024-11-27T18:47:31.534ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
25812024-11-27T18:47:31.534ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 140.639484ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25822024-11-27T18:47:31.540ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25832024-11-27T18:47:31.540ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25842024-11-27T18:47:31.540ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b67810c-9238-4db0-9210-291666acc9c4", "content-length": "26", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
25852024-11-27T18:47:31.540ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25862024-11-27T18:47:31.540ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25872024-11-27T18:47:31.540ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25882024-11-27T18:47:31.540ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.621133ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25892024-11-27T18:47:31.541ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25902024-11-27T18:47:31.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25912024-11-27T18:47:31.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25922024-11-27T18:47:31.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25932024-11-27T18:47:31.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25942024-11-27T18:47:31.547ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25952024-11-27T18:47:31.547ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
25962024-11-27T18:47:31.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25972024-11-27T18:47:31.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25982024-11-27T18:47:31.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25992024-11-27T18:47:31.549ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
26002024-11-27T18:47:31.549ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26012024-11-27T18:47:31.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26022024-11-27T18:47:31.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26032024-11-27T18:47:31.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26042024-11-27T18:47:31.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26052024-11-27T18:47:31.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26062024-11-27T18:47:31.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26072024-11-27T18:47:31.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26082024-11-27T18:47:31.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26092024-11-27T18:47:31.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26102024-11-27T18:47:31.554ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
26112024-11-27T18:47:31.554ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26122024-11-27T18:47:31.554ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
26132024-11-27T18:47:31.554ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 160.283436ms iteration = 14 status = {"generation":2}
26142024-11-27T18:47:31.556ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26152024-11-27T18:47:31.556ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26162024-11-27T18:47:31.556ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
26172024-11-27T18:47:31.556ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 162.151934ms iteration = 14 status = {"generation":1}
26182024-11-27T18:47:31.557ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26192024-11-27T18:47:31.557ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26202024-11-27T18:47:31.557ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b29ca8ba-09a8-4f14-bae6-29ecc766af2b", "content-length": "26", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
26212024-11-27T18:47:31.557ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26222024-11-27T18:47:31.558ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26232024-11-27T18:47:31.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26242024-11-27T18:47:31.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26252024-11-27T18:47:31.573ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 179.370269ms iteration = 30 status = {"physical_disks_added":0}
26262024-11-27T18:47:31.629ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
26272024-11-27T18:47:31.629ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26282024-11-27T18:47:31.629ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "360ed7fb-c906-422d-a927-7fbc44e65512", "content-length": "26", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
26292024-11-27T18:47:31.629ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26302024-11-27T18:47:31.631ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
26312024-11-27T18:47:31.652ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26322024-11-27T18:47:31.717ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26332024-11-27T18:47:31.748ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 354.639697ms iteration = 27 status = {}
26342024-11-27T18:47:31.846ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26352024-11-27T18:47:31.846ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b4ff6bb-8690-49ba-8e65-2f7f2e693b7d", "content-length": "2", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
26362024-11-27T18:47:31.847ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26372024-11-27T18:47:31.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26382024-11-27T18:47:31.858ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26392024-11-27T18:47:31.858ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26402024-11-27T18:47:31.858ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "94de2276-e5b2-4df4-83ae-2b5c03df456e", "content-length": "372", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
26412024-11-27T18:47:31.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26422024-11-27T18:47:31.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26432024-11-27T18:47:31.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26442024-11-27T18:47:31.861ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 466.712457ms iteration = 27 status = null
26452024-11-27T18:47:31.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26462024-11-27T18:47:31.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26472024-11-27T18:47:31.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26482024-11-27T18:47:31.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26492024-11-27T18:47:31.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26502024-11-27T18:47:31.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26512024-11-27T18:47:31.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26522024-11-27T18:47:31.875ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
26532024-11-27T18:47:31.875ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26542024-11-27T18:47:31.875ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "17c6a291-b08b-4ba8-a667-d54a73d29f99", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
26552024-11-27T18:47:31.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26562024-11-27T18:47:31.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26572024-11-27T18:47:31.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26582024-11-27T18:47:31.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26592024-11-27T18:47:31.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26602024-11-27T18:47:31.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26612024-11-27T18:47:31.883ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26622024-11-27T18:47:31.883ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26632024-11-27T18:47:31.884ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "86380d9d-cab8-4a2a-893f-0e5f930edc89", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
26642024-11-27T18:47:31.886ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 491.678977ms iteration = 28 status = {}
26652024-11-27T18:47:31.932ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26662024-11-27T18:47:31.971ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26672024-11-27T18:47:31.972ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "97d6722c-aefd-4879-90d6-a4acd710a1c6", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26682024-11-27T18:47:31.972ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26692024-11-27T18:47:31.974ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "97c6433d-deed-4799-acc9-a8ddc248ac76", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26702024-11-27T18:47:31.975ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26712024-11-27T18:47:31.977ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26722024-11-27T18:47:31.977ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 583.024341ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26732024-11-27T18:47:31.982ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26742024-11-27T18:47:31.983ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "75cd39f0-ba86-4340-a337-d8acb54847a8", "content-length": "691", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
26752024-11-27T18:47:31.983ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26762024-11-27T18:47:31.983ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26772024-11-27T18:47:31.983ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26782024-11-27T18:47:31.985ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 591.549647ms iteration = 28 status = {}
26792024-11-27T18:47:32.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26802024-11-27T18:47:32.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26812024-11-27T18:47:32.032ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
26822024-11-27T18:47:32.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26832024-11-27T18:47:32.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26842024-11-27T18:47:32.038ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26852024-11-27T18:47:32.039ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "67e3798b-9532-4412-bf79-69744303840c", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26862024-11-27T18:47:32.039ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26872024-11-27T18:47:32.040ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1cfb3026-9dd6-4763-b6da-0758e21ae86a", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26882024-11-27T18:47:32.041ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26892024-11-27T18:47:32.042ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d731fca8-9d85-446c-afcd-a246c815b2d5", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26902024-11-27T18:47:32.042ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26912024-11-27T18:47:32.044ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26922024-11-27T18:47:32.044ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 650.360379ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26932024-11-27T18:47:32.045ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26942024-11-27T18:47:32.045ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "916aedf0-4ae6-4d93-8333-68f28dc138c0", "content-length": "134", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
26952024-11-27T18:47:32.045ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26962024-11-27T18:47:32.045ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
26972024-11-27T18:47:32.045ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26982024-11-27T18:47:32.046ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26992024-11-27T18:47:32.046ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27002024-11-27T18:47:32.046ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27012024-11-27T18:47:32.046ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27022024-11-27T18:47:32.046ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27032024-11-27T18:47:32.046ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27042024-11-27T18:47:32.046ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27052024-11-27T18:47:32.046ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
27062024-11-27T18:47:32.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27072024-11-27T18:47:32.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27082024-11-27T18:47:32.049ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27092024-11-27T18:47:32.049ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b76a12f0-ff6b-41d2-a3de-b0bd123cc4f6", "content-length": "2", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
27102024-11-27T18:47:32.049ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27112024-11-27T18:47:32.049ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b89055d2-dd8d-4de8-a1dc-d7d84e388808", "content-length": "52", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
27122024-11-27T18:47:32.049ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
27132024-11-27T18:47:32.049ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27142024-11-27T18:47:32.163ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dd30961c-c007-4c31-bbe3-c17e1ef7ce36", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
27152024-11-27T18:47:32.163ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
27162024-11-27T18:47:32.163ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27172024-11-27T18:47:32.255ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "50979c45-9f5b-43a7-a64a-1d103d873152", "content-length": "682", "date": "Wed, 27 Nov 2024 18:47:31 GMT"} })
27182024-11-27T18:47:32.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27192024-11-27T18:47:32.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27202024-11-27T18:47:32.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27212024-11-27T18:47:32.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27222024-11-27T18:47:32.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27232024-11-27T18:47:32.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27242024-11-27T18:47:32.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27252024-11-27T18:47:32.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27262024-11-27T18:47:32.272ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 878.107085ms iteration = 27 status = {}
27272024-11-27T18:47:32.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 112456b3-1771-4c52-9448-8ed3bd902297 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27282024-11-27T18:47:32.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 112456b3-1771-4c52-9448-8ed3bd902297 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27292024-11-27T18:47:32.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 112456b3-1771-4c52-9448-8ed3bd902297 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27302024-11-27T18:47:33.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06152b9c-cd4d-4ca0-8c0d-466fa2748186 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27312024-11-27T18:47:33.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06152b9c-cd4d-4ca0-8c0d-466fa2748186 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27322024-11-27T18:47:33.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06152b9c-cd4d-4ca0-8c0d-466fa2748186 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27332024-11-27T18:47:33.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 7e2affd3-ce9d-452e-a338-23f1fd6b0c5f response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
27342024-11-27T18:47:34.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3ccf2737-630d-4f76-bf9b-c77977567968 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27352024-11-27T18:47:34.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3ccf2737-630d-4f76-bf9b-c77977567968 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27362024-11-27T18:47:34.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3ccf2737-630d-4f76-bf9b-c77977567968 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27372024-11-27T18:47:35.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dea7b7a-a8ba-4f5a-861a-7472906d9608 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27382024-11-27T18:47:35.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dea7b7a-a8ba-4f5a-861a-7472906d9608 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27392024-11-27T18:47:35.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dea7b7a-a8ba-4f5a-861a-7472906d9608 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27402024-11-27T18:47:36.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a03d1777-2a1b-4c49-a4e8-a4d2f0a2e21f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27412024-11-27T18:47:36.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a03d1777-2a1b-4c49-a4e8-a4d2f0a2e21f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27422024-11-27T18:47:36.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a03d1777-2a1b-4c49-a4e8-a4d2f0a2e21f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27432024-11-27T18:47:37.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1b88c38f-a7ef-47c8-8641-7df4c4ab2f96 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27442024-11-27T18:47:37.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1b88c38f-a7ef-47c8-8641-7df4c4ab2f96 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27452024-11-27T18:47:37.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1b88c38f-a7ef-47c8-8641-7df4c4ab2f96 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27462024-11-27T18:47:38.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30cc5a94-47e8-47b0-baff-94a9f7ad72dc roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27472024-11-27T18:47:38.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30cc5a94-47e8-47b0-baff-94a9f7ad72dc resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27482024-11-27T18:47:38.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30cc5a94-47e8-47b0-baff-94a9f7ad72dc response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27492024-11-27T18:47:39.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6816247b-3394-4b2f-8cd3-3aa744a26884 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27502024-11-27T18:47:39.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6816247b-3394-4b2f-8cd3-3aa744a26884 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27512024-11-27T18:47:39.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6816247b-3394-4b2f-8cd3-3aa744a26884 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27522024-11-27T18:47:40.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 875476ef-a00c-4685-a6c6-7401edfe4419 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27532024-11-27T18:47:40.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 875476ef-a00c-4685-a6c6-7401edfe4419 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27542024-11-27T18:47:40.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 875476ef-a00c-4685-a6c6-7401edfe4419 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27552024-11-27T18:47:41.394ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
27562024-11-27T18:47:41.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27572024-11-27T18:47:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27582024-11-27T18:47:41.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
27592024-11-27T18:47:41.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27602024-11-27T18:47:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27612024-11-27T18:47:41.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27622024-11-27T18:47:41.396ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27632024-11-27T18:47:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27642024-11-27T18:47:41.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.336744ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27652024-11-27T18:47:41.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27662024-11-27T18:47:41.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27672024-11-27T18:47:41.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27682024-11-27T18:47:41.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27692024-11-27T18:47:41.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27702024-11-27T18:47:41.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27712024-11-27T18:47:41.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
27722024-11-27T18:47:41.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27732024-11-27T18:47:41.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27742024-11-27T18:47:41.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
27752024-11-27T18:47:41.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.831604ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
27762024-11-27T18:47:41.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6518c3c3-c401-4280-a8ff-573511610fa1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27772024-11-27T18:47:41.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6518c3c3-c401-4280-a8ff-573511610fa1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27782024-11-27T18:47:41.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6518c3c3-c401-4280-a8ff-573511610fa1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27792024-11-27T18:47:42.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 483e1b92-dfef-4843-b7cf-ba1605fdaad6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27802024-11-27T18:47:42.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 483e1b92-dfef-4843-b7cf-ba1605fdaad6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27812024-11-27T18:47:42.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 483e1b92-dfef-4843-b7cf-ba1605fdaad6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27822024-11-27T18:47:43.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 25349d4b-d4ac-4dfa-ba2d-099c1fdf300c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27832024-11-27T18:47:43.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 25349d4b-d4ac-4dfa-ba2d-099c1fdf300c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27842024-11-27T18:47:43.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 25349d4b-d4ac-4dfa-ba2d-099c1fdf300c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27852024-11-27T18:47:43.575ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:34656
27862024-11-27T18:47:43.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34656 req_id = 47a419da-15ab-463a-ad28-cdb177d8e71b roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
27872024-11-27T18:47:43.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34656 req_id = 47a419da-15ab-463a-ad28-cdb177d8e71b resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
27882024-11-27T18:47:43.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34656 req_id = 47a419da-15ab-463a-ad28-cdb177d8e71b response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
27892024-11-27T18:47:43.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34656 req_id = c7b1032f-f207-4f7f-808d-6a1590ca3cb3 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
27902024-11-27T18:47:43.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34656 req_id = c7b1032f-f207-4f7f-808d-6a1590ca3cb3 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
27912024-11-27T18:47:43.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34656 req_id = c7b1032f-f207-4f7f-808d-6a1590ca3cb3 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
27922024-11-27T18:47:43.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 532 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 0ac337ed-3367-437e-90ed-293966dbebc8 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
27932024-11-27T18:47:44.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fd922b4a-7938-4a21-8d97-ee8a34f14172 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27942024-11-27T18:47:44.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fd922b4a-7938-4a21-8d97-ee8a34f14172 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27952024-11-27T18:47:44.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fd922b4a-7938-4a21-8d97-ee8a34f14172 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27962024-11-27T18:47:45.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3b950bb9-e522-4200-ab64-00f593d0f6fe roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
27972024-11-27T18:47:45.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3b950bb9-e522-4200-ab64-00f593d0f6fe resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
27982024-11-27T18:47:45.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3b950bb9-e522-4200-ab64-00f593d0f6fe response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
27992024-11-27T18:47:45.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 080ed49c-d2a1-4976-b7bc-74a5109eafe4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28002024-11-27T18:47:45.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 080ed49c-d2a1-4976-b7bc-74a5109eafe4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28012024-11-27T18:47:45.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 080ed49c-d2a1-4976-b7bc-74a5109eafe4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28022024-11-27T18:47:46.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ce2363a0-ea51-4fbe-ae0a-47a5ce991858 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28032024-11-27T18:47:46.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ce2363a0-ea51-4fbe-ae0a-47a5ce991858 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28042024-11-27T18:47:46.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ce2363a0-ea51-4fbe-ae0a-47a5ce991858 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28052024-11-27T18:47:47.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 463eb175-40e9-4349-98dc-0ed5b3262f24 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28062024-11-27T18:47:47.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 463eb175-40e9-4349-98dc-0ed5b3262f24 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28072024-11-27T18:47:47.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 463eb175-40e9-4349-98dc-0ed5b3262f24 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28082024-11-27T18:47:48.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dc384ab2-f944-4b5a-ac22-5c36cd506995 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28092024-11-27T18:47:48.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dc384ab2-f944-4b5a-ac22-5c36cd506995 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28102024-11-27T18:47:48.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dc384ab2-f944-4b5a-ac22-5c36cd506995 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28112024-11-27T18:47:49.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8bc6c5fa-99ef-4df3-a49a-0cf879ab8054 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28122024-11-27T18:47:49.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8bc6c5fa-99ef-4df3-a49a-0cf879ab8054 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28132024-11-27T18:47:49.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8bc6c5fa-99ef-4df3-a49a-0cf879ab8054 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28142024-11-27T18:47:50.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c0afb2d1-4dbf-4448-80ce-2029996a837c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28152024-11-27T18:47:50.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c0afb2d1-4dbf-4448-80ce-2029996a837c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28162024-11-27T18:47:50.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c0afb2d1-4dbf-4448-80ce-2029996a837c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28172024-11-27T18:47:51.394ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
28182024-11-27T18:47:51.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28192024-11-27T18:47:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28202024-11-27T18:47:51.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
28212024-11-27T18:47:51.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28222024-11-27T18:47:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28232024-11-27T18:47:51.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28242024-11-27T18:47:51.396ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28252024-11-27T18:47:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28262024-11-27T18:47:51.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.592694ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28272024-11-27T18:47:51.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28282024-11-27T18:47:51.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28292024-11-27T18:47:51.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28302024-11-27T18:47:51.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28312024-11-27T18:47:51.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28322024-11-27T18:47:51.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28332024-11-27T18:47:51.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
28342024-11-27T18:47:51.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28352024-11-27T18:47:51.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28362024-11-27T18:47:51.414ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
28372024-11-27T18:47:51.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.18999ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
28382024-11-27T18:47:51.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bd1346e9-9b87-4b0c-bff0-4a692633da59 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28392024-11-27T18:47:51.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bd1346e9-9b87-4b0c-bff0-4a692633da59 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28402024-11-27T18:47:51.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bd1346e9-9b87-4b0c-bff0-4a692633da59 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28412024-11-27T18:47:52.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c132af5d-3f85-4ce5-90a8-b650f91db838 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28422024-11-27T18:47:52.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c132af5d-3f85-4ce5-90a8-b650f91db838 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28432024-11-27T18:47:52.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c132af5d-3f85-4ce5-90a8-b650f91db838 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28442024-11-27T18:47:53.585ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 662 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 558f795b-25a5-4b2e-b810-80dbf7bf65d7 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
28452024-11-27T18:47:53.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 712e4d92-7491-46e8-a2cd-bf1829b8a50c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28462024-11-27T18:47:53.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 712e4d92-7491-46e8-a2cd-bf1829b8a50c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28472024-11-27T18:47:53.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 712e4d92-7491-46e8-a2cd-bf1829b8a50c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28482024-11-27T18:47:54.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b68aaf5c-ee5b-4e66-842f-9b47d4cd2ae9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28492024-11-27T18:47:54.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b68aaf5c-ee5b-4e66-842f-9b47d4cd2ae9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28502024-11-27T18:47:54.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b68aaf5c-ee5b-4e66-842f-9b47d4cd2ae9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28512024-11-27T18:47:55.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b63ec8a4-30b8-444b-a088-213ebdfa9011 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28522024-11-27T18:47:55.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b63ec8a4-30b8-444b-a088-213ebdfa9011 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28532024-11-27T18:47:55.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b63ec8a4-30b8-444b-a088-213ebdfa9011 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28542024-11-27T18:47:56.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46d421be-5436-4e2a-a48c-32646935b52d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28552024-11-27T18:47:56.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46d421be-5436-4e2a-a48c-32646935b52d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28562024-11-27T18:47:56.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46d421be-5436-4e2a-a48c-32646935b52d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28572024-11-27T18:47:57.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e2199eae-b4b0-4430-8921-627e4f1646fb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28582024-11-27T18:47:57.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e2199eae-b4b0-4430-8921-627e4f1646fb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28592024-11-27T18:47:57.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e2199eae-b4b0-4430-8921-627e4f1646fb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28602024-11-27T18:47:58.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3914a8b-1427-48bd-b6f1-eabbfb5adc52 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28612024-11-27T18:47:58.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3914a8b-1427-48bd-b6f1-eabbfb5adc52 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28622024-11-27T18:47:58.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3914a8b-1427-48bd-b6f1-eabbfb5adc52 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28632024-11-27T18:47:59.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb28047e-2846-4f54-9b73-df113430116e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28642024-11-27T18:47:59.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb28047e-2846-4f54-9b73-df113430116e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28652024-11-27T18:47:59.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb28047e-2846-4f54-9b73-df113430116e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28662024-11-27T18:48:00.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dca107f9-7f91-4a69-9385-3719520b3e5e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28672024-11-27T18:48:00.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dca107f9-7f91-4a69-9385-3719520b3e5e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
28682024-11-27T18:48:00.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dca107f9-7f91-4a69-9385-3719520b3e5e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b